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I . Int.mduc t i on 


1 . 1 . The  buzz  Words 

MINOS  stands  for  "a  Modular  In-core  Nonlinear  Optimization 
System."  It  sounds  roughly  like  the  first  character  in  (minus 

infinity),  and  its  purpose  is  to  ontimi.,--  your  own  special  ob.ieo live 
func  tion  f(x)  by  finding  a point  >:  which  makes  f(x)  as  close 
to  1*  as  possible. 

Since  it  is  not  normally  meaningful  to  go  quite  that  far, 

MINOS  allows  you  to  restrict  the  variables  x to  some  feasible 
region  specified  by  a set  of  1 inear  constrn  1 nt.c  (Ax  b)  md  a 
set  of  upper  and  lower  bo’inds  (l  < x < u) . in  particular,  the  matrix 
A may  be  large  and  sparse.  Of  course  A may  be  small  and  sparse,  or 
even  small  and  dense;  in  general,  the  smaller  and  sparser  the  better. 

Ideally  your  objective  function  f(x)  should  be  smooth,  the 
nonlinear  part  of  it  should  involve  as  few  of  the  components  of  x 
as  possible,  and  you  should  know  how  to  cnmpute  the  gradient  vector 
g(x)  = (uf/dxp  at  any  feasible  point  x. 

With  the  important  words  thus  introduced,  we  will  now  leave 
an  example  problem  to  speak  for  itself.  The  remainder  of  this  section 
contains  the  following: 

— a statement  of  the  problem; 

— a Fortran  subroutine  to  compute  fix)  and  g(x); 

— input  cards  to  be  read  by  MINOS; 

— the  output  produced  during  solution  of  the  problem. 
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The  reader  should  not  expect  to  understand  all  Items  immediately. 
However,  the  example  should  help  to  determine  If  a particular  problem 
is  of  the  requisite  form,  and  may  serve  a3  a useful  reference  there- 
after. Note  that  "x"  in  this  example  is  the  vector  (x,  y,  z). 


Example  1 


Objective: 

minimize 

f(x,  y,  z)  = x'~  4 

Li nea  r C ons  t ra i nts : 

x + y 

< 2 

x + y - z 

= 0 

Bounds : 

x > 0, 

1 < z < 5 

Nonlinear  Variables: 

x and  y 

Fortran  Subroutine  to  Compute  the  Nonlinear  Part  of  f(x,  y,  z) 
and  its  Gradient 


SUBROUT  I HE  CALC  FG  < MODE  , N , X , i-  ,b,i  ISTH  T E , ill  PUD  :• 

I MPL I C IT  REAL*8 < H-H  , 0-Z :< 

DIME  MSI  Oh  «H  ■ , h K h :< 

C 

C EUflLUHTE  FUNCT10M  R HMD  GRADIENT  G AT  CURRENT  POINT 

C THE  INTEGER  N WILL  bE  2 IN  THIS  EXAMPLE. 

C 

T = X < 2 > - 1.0 
F = X' 1 >**2  + T**4 
GO)  = 2.0#X<1> 

G<2)  - 4.u#1**3 

RETURN 

END 


(The  parameters  of  subroutine  CALCFG  are  defined  in  Section  III. 3.) 
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1 ' t)i i L i r le  to  be  hea  i by  Ml  NO.1'  ' ' 


data,  f'o  i I ; .v  UP."  lata) 


BEGIN  SPECS  f OP  t ;:hmpi  1 

ppi  if  :t  i r 

minimize 

1 tfc:JEc  T IOE 

OF:  J.  PON 

PH'  • 

PH':  1 

BOUND:, 

BNl.11 

PON':. 

1 0 

♦ T h e r ► 

fiuffi  n . r 

r itiu  i se 

i OLUNNs 

20 

♦ fivzr-' 

1 > hit  1 i ; 

, , f » r,  t O' 

>1  <i 

LEI  IE!  H 

1 0 0 

t .it  t r, ►- 

< •.*  n t r , i i 

i ft  t lua  t r I i 

1 7 ERA T IONS 

1 u 0 

SOL U7 ION 

7ES 

PROBLEM  HO. 

NONLINEAR  "HR  I ARLES 
SUPERBAS I C S 
L I NESEhPCH  TOLERANCE 
END  EXAMPLE  SPECS 


NAME  EXAMPLE! 

p i.i  Ns 

H OBJ.  PON 
L R0W0U1 
L ROMO 02 
COLUMNS 


OBJ . PON 

~H  . 0 

RON 00 1 

1 . 0 

,■ , 

PONU 0 2 

1 . 0 

1 t 
1 

ROWiJ  0 1 

1 . ij 

POND 02 

i . U 

£• 

OBJ . RON 

1 . Ij 

PONU 02 

-1.0 

PHS 

RHS 1 

PONOiJ  1 

2 . C 

90  Ul  IDS 

i p burn 

1.  1 
1 

LO  BNU 1 

<L 

1 . 0 

UP  BNDI 
EMU AT A 

£ 

5 . U 

Co  t urn a 

nutTi  oers  tor  f i ► i i a 

J M 

I'lPS 

d&tii  CdfdS! 

1 ! i 
12  5 

1HME  1 ! NAME  1 ! 

12  IS  22  25 

UHLUE 

1 1 NAME  ! 

30  HO  H7 

: VALUE 

50 

NOTE: 

The  nonlinear  variables 

X 

and 

Y must  appear  f 

't  rat 

In  the  CODJMNS  section  of  the  MPT.  date. 
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1.2. 


Formal  Introduction 


MINOS  Is  a computer  program  designed  to  minimize  a linear  or 
nonlinear  function  subject  to  linear  constraints.*  In  algebraic 
terms  it  is  designed  to  solve  problems  of  the  form 

T 

minimize  f(x)  + c x 

P: 

subject  to  Ax  5 1),  £ < x < u 

given  that  f(x)  is  a continuous  differe.ic iable  function 
with  gradient  Vf(x)  - [rtf/ctx.l  = g(x). 

Such  problems  range  from  small,  unconstrained  optimization  problems 
through  constrained  linear  least  squares  (data-f itting)  models  to 
large-scale  linear  programs  with  (or  without)  nonlinear  terms  in 
the  objective.  In  general  the  constraint  matrix  A is  assumed  to 
be  large  and  sparse. 

Fundamental  to  the  system  is  an  efficient  and  reliable  imple- 
mentation of  the  revised  simplex  method  for  linear  programming  (LP).* 
This  combines  established  sparse-matrix  technology  with  stable  numeri- 
cal methods  for  computing  and  modifying  a triangular  factorization 
of  the  usual  square  basis  matrix  B.  The  code  is  intended  to  be  suit- 
able for  production  runs  on  purely  linear  problems.  The  data  formats 
used  for  various  files  therefore  follow  those  adopted  by  current 
commercial  mathematical  programming  systems.  In  particular,  the 

*The  theory  of  the  solution  technique  is  described  in  a companion 
paper,  Murtagh  and  Saunders  (1976). 

*Dantzig  (1963). 

^Bartels  and  Golub  (1969),  Bartels  (1971),  Saunders  (1976). 


8 


quant.  I tic:?  A,  h,  , /■  and  u arc  define'  i i ..he  format  accepted 
the  IBM  Mat ; i h - ...  ■ , MPP  . Mi  iX  a i i 

■ 70.  1 ieally  t h<  •eader  if  f Is  nanual  should  have  rlei 

in  using  .such  syst-ms  and  should  (h  fortiori)  (.•  familiar  with  the 
ioncej  ts  and  • rmii  ■!  igy  a soc ia  ed  with  the  simplex  nethod. 

Recall  that  the  basic  variable  r associated  with  H may  take 
Lutio»  ral  ■ : i ywher  be  ween  t ir  tpper  1 Her  bounds,  and 

that,  the  remaining  variables  or*  ! • ! i o 1 asi t • or 

other  of  their  bounds.  The  simplex  method  always  works  with  solution;, 
of  this  form.  In  orde~  to  extend  the  simplex  method  to  problem  P we 
introduce  a new  class  of  variables,  which  will  tit  called  suoeri  aslc. 
Both  basic  and  superbasic  variables  may  vary  between  their  bounds, 
but  in  the  reduced -gradient  approach  used  here  their  roles  are 
aifferent.  Suppose  there  are  ns  superbasic  variables  at  some  stage. 
These  are  essentially  free  to  move  in  any  desirable  direction,  namely 
one  which  will  improve  the  value  of  the  objective  functions;  in 
effect  they  provide  the  driving  force.  The  basic  variables  can 
trier  be  adjusted  so  that  the  full  set  of  variables  x remains  feasible 
with  respect  to  the  linear  constraints.  If  it  appears  that  no  improve- 
ment can  he  made  with  the  current  set  of  superbasics,  one  (or  more) 
of  the  nonbasic  variables  Is  selected  to  ■ • «w  superbasic,  ns  is 
increased  and  the  process  i3  repeated.  At  all  stages,  if  a basic 
or  superbasic  variable  encounters  one  of  its  bounds,  an  adjustment 
occurs  In  which  that  variable  is  made  nonbasic  and  the  total  number 
of  superbasics  is  reduced  by  1. 


T Wolfe  (1962,  1967). 


* 
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Users  familial-  with  IP  may  interpret  the  simplex  method  be 
being  exactly  the  above  process,  with  ns  oscillating  between  0 
and  1. 

At  any  given  stage,  the  number  of  superbasics  (ns)  measures 
in  some  sense  how  far  the  current  point  x is  from  a vertex  of  the 
simplex  (polyhedron)  defining  the  feasible  region.  In  other  words, 
x lies  somewhere  on  a face  of  the  polyhedron,  which  defines  a sub- 
space  of  dimension  ns.  An  important  part  of  MINOS  is  a stable 
implementation  of  a cmas i -Newton  (or  variable-metric)  method  for 
optimizing  the  superbasic  variables  within  each  appropriate  subspace. 
This  method  uses  a triangular  matrix  of  dimension  ns  to  approximate 
the  reduced  Hess ian  (i.e.,  a suitably  transformed  sub-section  of  the 

O 

matrix  of  second  derivatives,  [3cf/t)x.cbt.]).  Good  rates  of  conver- 

— iJ 

pence  are  usually  achieved. 

If  the  number  of  superbasic  variables  ever  grows  as  large 
as  100  or  200  the  storage  required  for  the  quasi-Newton  procedure 
starts  to  become  excessive.  In  such  cases  MINOS  will  commence  using 
a ■•on.i  up  ate -gradient  method,*  which  requires  very  little  storage. 

The  rate  of  convergence  normally  drops  severely,  but  at  present  this 
is  the  only  practical  alternative  for  problems  with  very  many 
nonlinearities. 

The  concept  of  superbasic  variables  can  be  valuable  even  for 
purely  linear  problems.  As  an  example,  the  solution  to  a particular 
problem  may  provide  a feasible  but  non-vertex  starting  point  for  a 
modified  version  of  the  problem  (e.g.,  if  the  bounds  were  altered  on 
some  nonbasic  variables).  The  re-starting  features  in  MINOS  allow 

"^Davldon  (1909) > Fletcher  and  Powell  (1903). 

* Fletcher  and  Reeves  (190*4). 
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the  user  to  take  advantage  of  -uch  ;i  Luatlonr:  easily.  On  a less 
routine  level,  MINOS  also  prov:Jes  a framework  within  which  experi- 
ments  can  be  performed  on  large  problem;:  using  non-o implex  steps, 
perhaps  with  a view  to  reducing  the  total  number  of  iterations  required, 


1.3.  The  Canonical  Korn 


Without  loss  of  generality,  problem  P may  be  re-cast  in 


the  form 


minimize  f(x..)  - s , . 

N ob.i 


subject  to 


[an  Atb  1: 


0,  l < < u 

P 


given  W(xN)  - gCxN) 


where  the  following  definitions  hold: 


the  nonlinear  variables . i.e.,  those  that  are  directly  involved 

in  the  function  f (x..) . 

N 

= the  linear  variables,  i.e.,  the  remaining  part  of  x. 


- the  rit;h  t-har 


variable,  which  ha.-;  bounds  i = u - -1.0 
’ P P 
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the  ;lne  1;  or  lor  ice  I va  rig.  ! • • : ■ (one  for  • ach  row  or'  A). 

the  slack  variable  corresponi  in.-  to  t,h  - linear  part  (if  any) 

T 

of  IJie  ob.iective  function.  'Hie  ierm  c y in  problem  P 

In  thus  imbedded  in  the  con.trn  int  matrix  as  the  "ob,j ”-th 
T 

constraint,  c x + s , . 0,  with  s , . being  a free*  variable, 

obj  ’ obj 

(This  row  may  be  omitted  if  c 0 or  if  c is  included  in  f.) 
= ■ 

the  number  of  rows  in  A. 

= the  number  of  columns  in  A. 

the  number  of  nonlinear  variables  in  x . 

n 

= the  number  of  superbasic  variables. 


At  any  particular  stage,  the  columns  of  (A  b 1]  are  implicitly 
ordered  as  follows: 


[A  b I)P 


n + 1 - ns 


Basics,  as  in  Nonbasics 

simplex  method  Superbaslcs  (variables  at  upper 

or  lower  bound) 


where  P is  a permutation.  The  nonlinear  variables  may  end  up 
anywhere  in  h,  S or  N,  and  similarly  the  superbasic  variables  in 
S may  be  linear  or  nonlinear.  The  only  requirement  is  that  the  basis 


matrix  B be  nonsingular. 


f 

I 

I 


The  above  partitioning  should  be  remembered  when  interpreting 
output  from  MINOS  and  when  modifying  certain  basis  files  for  input. 


II. 


Nonlinear  Problems 


At  any  given  stage,  the  reduced-gradient  method  regards  the 

objective  as  an  essentially  unconstrained  function  of  the  super- 

hasic  variables  alone.  (Basic  and  nonbasie  variables  are  eliminated 

hy  means  of  the  active  constraints.)  It  is  therefore  possible  to 

use  unconstrained  optimization  methods  on  some  "reduced  function" 

of  the  ns  superbasic  variables.  Suppose  that  the  original 

objective  has  gradient  g and  Hessian  G (i.e.,  the  matrix  of 

second  partial  derivatives).  The  gradient  and  Hessian  for  the 

T T 

reduced  function  are  then  Z g and  Z GZ,  where  Z is  defined  in 
terms  of  the  current  basis  as  the  n * ns  matrix 

l 

m 
ns 

n + 1 - m - ns 

T 

Note  that  it  would  not  be  practical  to  compute  Z or  Z GZ 

(assuming  m to  be  large  and  ns  to  be  more  than  1 or  2) . 

Any  unconstrained  optimization  method  to  be  used  must  therefore 

T 

make  do  with  vectors  of  the  form  Z g or  Zp,  which  can  be  computed 
with  relative  ease. 


1U 


I 


1 


II. 1 


'i'he  'J.uas  i-Newton  Method 


Whenever  storage  permits,  as  specified  by  a HE'SE'JAN  DDAENT.ION 
card  in  the  SPECS  file  (see  Section  U) , MINOS  maintains  a quasi- 
Newton  approximation  to  the  reduced  Hessian  thus: 

T T 

R R %.  Z GZ 

where  R is  a dense,  nonsingular,  upper  triangular  matrix  of 
dimension  ns.  This  normally  provides  superlinear  convergence  to 
a minimum  within  the  subspace  defined  by  each  set  of  superbasie 
variables.  The  factorized  form  R R is  justified  by  the  fact 

m 

that  Z GZ  must  be  positive  definite  (or  at  least  semi-definite) 
at  such  a minimum.  It  also  guarantees  that  the  equations 

T T 

R Rs  - -Z  g,  p = Zs 

will  generate  a direction  p along  which  the  original  objective 
will  decrease  (since  the  projection  of  p along  the  gradient  is 
PTg  = sTzTg  - -strtrs  = -iiRsii:;  < o). 

Various  modifications  are  made  to  R each  iteration  to 
account  for  new  curvature  information  and  to  allow  for  changes  in 
the  number  of  superbasics.  For  example,  when  a nonzero  step  is 
taken,  a new  matrix  I?  is  computed  in  two  stages  to  satisfy 

T T T T 

RAfT  = R R + vv  - ww 
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for  some  vectors  v and  w (which  nre  determined  by  the  so-called 


"Complement  a ry  DFP"  or  "BEGS"  f omul  a,  e.g.,  see  Broyden  (1972))* 

The  result  of  such  operations  on  R is  briefly  indicated  in  the 
iteration  lot'  by  two  integers  labelled  "RIM"  (short  for  Rank-one 
Modifications).  In  general,  these  numbers  are: 

positive  if  the  modifications  were  successful; 

zero  if  the  change  in  reduced  gradient  was  too  small  for  v 

and  w to  be  meaningful  (in  which  case  R is  unaltered); 
negative  if  numerical  error  prevented  a particular  modification. 

Another  useful  quantity  appearing  in  the  iteration  log  is 

T 

an  estimate  of  the  "condition  number"  of  R R.  See  the  discussion 
of  H-CONDN  in  Section  VII  ; also  3ee  Section  II. 3* 

II. 2.  The  Con.iur ate-Gradieut  Method 

If  insufficient  storage  has  been  allocated  for  R,  MINOS 
will  discontinue  the  quasi-Newton  method  for  generating  search  direc- 
tions and  switch  to  a conjugate -grad lent  method  (which  does  not  need 
R) . Th°  dimension  of  R may  be  specified  separately  from  the  upper 
limit  on  superbasics,  thus: 


SUPERRASICS  200 

HESSIAN  DIMENSION  100 
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In  this  example  a conjugate-gradient  method  wiJl  be  used  if  the 
number  of  superbasics  exceeds  100.  Quasi-Newton  iterations  can  be 


suppressed  completely  by  the  card 

HESSIAN  DIMENSION  0 

(The  total  no.  of  iterations  will  probably  increase  significantly.) 
Five  versions  of  "CG"  are  currently  available  via  the  SPECS 

card 

CONJUGATE  GRADIENT  VERSION  k 
for  the  following  values  of  k: 
k Method 

1 Fletcher  and  Reeves  (1964) 

2 Polak  and  Ribiere  (1969) 

3 Perry  (1976) 

4 Memoryless  DFP 

5 Memoryless  Complementary  DFP 

The  general  form  of  the  first  three  methods  is 

s = -ZJg  + 0sold 
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fire  the  new  and  previous  search  directions 


I 


wiie  re 


and 


old 


for  the  superbasi.oa,  and  fi  depends  on  the  method.  'Ihe  other 
two  method:;  are  derived  from  the  corresponding  quasi -Newton  formulas, 
tnki;ig  the  initial  reduced  iiessian  approximation  to  be  I.  They 
add  to  s a term  of  the  form 


/r,T  ,.T  v 

s - z gold)  • 

Restarts  (&  = y 0)  occur  at  every  change  to  the  basic  or  super- 
basic  sets,  or  after  ns  consecutive  uneons trained  steps  with  a 
particular  set  of  ns  superbasics. 

Hie  state  of  research  on  conjugate-gradient  methods  is  such 
that  no  clear  recommendation  can  be  made  for  the  choice  of  k.  If 
an  accurate  linesearch  is  used,  ail  methods  are  rather  similar  and 
k = 1 or  2 should  be  tried.  If  the  objective  function  is  so 
expensive  to  evaluate  that  an  inaccurate  search  is  necessary, 
k 3 or  5 may  be  preferable.  Method  4 appears  from  limited 
experience  to  tie  the  least  successful.  Considerable  further  research 
is  needed  in  this  area. 

II. 3.  Ijcalin^r  Nonlinear  Variables 

No  rigid  rules  can  be  given  here  that  would  apply  usefully 
to  all  nonlinear  functions,  but  one  quantity  in  particular  may  be 
worth  examining  if  it  seems  that  optimization  is  proceeding  very 
slowly.  This  quantity  is  cond(G),  the  condition  number  of  the 
Hess  i an . which  may  be  very  sensitive  to  scaling. 


l 
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We  shall  illustrate  with  a particular  function  of  two 
variables,  viz. 

f(x,  y)  = X y 

where  b and  c are  known  parameters.  It  is  readily  verified 
that  the  Hessian  for  f is 


O p 

cff/dx2 

c2f/cixoy 

b(b  - l)y"'  bcxy 

(x,  y)  = 

e)2f/cixciy 

» 

D2f/^y2 

2 2 

bcxy  c (c  - l)x^ 

x y 

Furthermore,  G may  be  factorized  as 


where 


G(x,  y) 


f x 

2 2 LL 
x y 


L 


Py 

yx  bx 


02  = b(b  - 1) 
y = bc/p 

b2  = c(l  - b - c) / (b  - 1). 
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A triangular  factorization  of  th Lr;  kind  provides  a lower*  bound  on 
th<  joi  lit  ion  m : . r of  G,  in  terms  of  the  ratio  of  the  largest 

aii  smallest  diagonals  of  L.  in  this  case,  suppose  that 
I By  I > I bx|  at  the  optimal  solution.  Then 


cond(G)  = cond(I,)r  > j 

Assuming  that  3 and  6 are  reasonable  numbers  (of  order  l) , it 

2 , 2 

appears  that  the  ratio  y /x  at  the  optimal  solution  may  be  a 

useful  indicator  of  the  sensitivity  of  the  optimum  to  small  changes 

in  the  data.  To  make  .the  estimate  of  cond(G)  close  to  1,  x and 

y should  be  sealed  to  have  approximately  the  same  values  at  the 

solution.  (The  same  conclusion  would  be  drawn  if  j 3yj  < j 5x|  . ) 

Warning : In  the  reduced~gradient  method,  scaling  for  the 

above  reasons  should  not  be  at  the  expense  of  upsetting  the  scale 

of  the  constraint  matrix,  A.  This  is  because  the  quantity  of 

T 

interest  is  really  cond(Z  GZ)  rather  than  cond(G),  where  Z is 
a matrix  whose  scale  (and  condition)  depend  on  A. 

Note  that  if  certain  variables  (and  hence  columns  of  A) 
are  scaled  to  improve  cond(G),  it  may  be  necessary  to  scale  certain 
rows  of  A to  maintain  the  condition  of  A and  Z^GZ.  It  may 
then  be  necessary  to  scale  certain  other  columns  of  A,  and  so  on. 
Clearly,  it  is  preferable  to  be  careful  with  scaling  during  the 
initial  formulation  of  a problem. 
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Finally,  the  analysis  suggested  above  will  usually  be  appli- 


cable to  certain  obvious  rows  and  columns  of  G,  rather  than  to 
G as  a wholej  for  example,  if  C.  is  block-diagonal,  each  block 
may  be  analyzed  in  turn. 


1 


r 


T 
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ill.  Inin  Hcq  . i re  i from  ’ 1 1-  • i j • • 


Tin  following  three  item.;  must  be  supplied  by  the  user: 

1.  the  SPE  S file  to  sp  ■ I certain  run-time  parameters; 

2.  the  MFC  file  to  specify  the  linenr  constraints  in 

standard  MPS  format; 

subroutine  Aid  to  compute  the  nonlinear  part  of  the 

objective  f'inction  and  its  gradient. 

The  user  may  also  (optionally)  supply 

U.  certain  BAS If  files  to  iefine  an  initial  solution. 

Since  several  or  all  of  the  various  input  files  could  be  part  of  the 
card  input  stream,  it  is  important  to  note  that  MINOS  reads  data  in 
the  following  order; 

(a)  SPECS  data 

(b)  MPS  data 

(c)  BASIS  data 

(d)  any  data  required  by  subroutine  CALCFG. 


ITI.l.  The  r*PK()S  File 

Certain  parameters  may  be  set  by  the  user  via  a list  of 
"problem  specifications,"  hereafter  called  SPECS.  These  are  assumed 
to  be  a deck  of  80-character  card  images  of  the  form 
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BEGIN  SPECS  FOR  KREl) 

(list  of  keywords  and  values) 

END  FRED 

where  the  words  BEGIN  and  END  are  themselves  keywurlc.  (Other  charac- 
ters on  BEGIN  and  END  cards  are  Ignored.)  The  SPECS  file  must  exist; 
it  is  normally  the  first  data  set  in  the  card  input  stream  (file  5). 

Broadly  speaking,  each  card  in  the  SPECS  file  contains  a 
sequence  of  items  punched  in  free  format  (i.e.,  separated  by  at  least 
one  blank  or  =) . The  items  selected  from  each  card  are 

1.  The  first  word  (the  keyword;  only  the  first  3 characters  are 

significant) ; 

2.  The  second  word  (8  characters,  treated  as  two  sets  of  4) ; 

3.  The  first  number  (up  to  8 characters;  either  integer  or  real). 

In  the  following  examples  the  significant  characters  are  underlined: 


OBJECTIVE  PROFIT 

ROWS  BOO 

AIJTOL  1.0E-6 

LOWER  BOUND  -1.0 

SOLUTION  FILE  20 

OLD  BIT  MAP  ON  FILE  2. 
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Only  occasionally  is  the  second  word  meaningful  (e.g.,  PROFIT  and 
FILE  above).  Woras  such  as  BOUND  and  BIT  MAP  are  extracted  but 
later  ignored. 

Blank  cards  are  allowed,  and  comments  (i.e.,  any  characters) 
may  occur  after  an  asterisk,  e.g., 

NONLINEAR  VARIABLES  20  * X005,  X010,  ...,  X100. 

I >*•  fault  Values 

Parameters  that  are  not  specified  in  the  SPECS  file  assume 
certain  default  values,  most  of  which  should  be  acceptable  for  normal 
use.  In  the  following  list  the  default  values  are  given  for  all 
legal  keywords.  Where  possible  (except  for  some  of  the  items  printed 
in  lower  case)  the  list  itself  constitutes  a valid  SPECS  file.  Note, 
however,  that  its  effect  would  be  essentially  the  same  as  the  file 


BEGIN 

END 


(which  is  also  valid). 


1 


i 

1 

I 


Pk 


► 


* 


fl 

n 


A SPKCS  Filr  .owlttr  nil 

I/vnl  Keyword 

find  Their  Default  Values 

BEQ I M h T LI  '•Hiil  lllib 

♦ 

fiEFRULT  "HI  Ui 

f 01 ' 1 i 

‘ II  III  1 f HRHtTI  1 FR' 

♦ 

♦ 

♦ 

4E7WOFDS  FOP  MRS  LU'ITR 

♦ 

MINIMIZE 

OBJECT  I "E  = * ri  * firs 

1 Oeilfi  £ » fi  •_  I ' i l*i  t ► 

r •'  U 

!-  HS 

-1 1 1 1 >:• 

PRNGES 

•1  1 1 1 o 

BOUNDS 

d i 1 1 o 

ROWS 

1 1J  0 

* 

COLUMNS 

300 

4 

1 or 

v/ROWS,' 

ELEMENTS  ■ COEFF IC IEf  TS> 

1 50  0 

4 

(.  o r 

5*  • COL  S • 

Hi  J ZERO  TOLERHHlF 

1 . OL-lu 

4 

LOWER  BOUND 

ii . 0 

* 

UPPER  BOUND 

1 . OE+si'i 

4 

4 

INPUT  FILE 

5 

♦ 

v MRS 

•id  t ri  1 

LIST  LIMIT 

ij 

4 

< f o r 

printing  of  TPS  ddtas 

♦ 

EF'PUR  MESSRbF  l I M I T 

10 

4 

< >lu  r i 

rr_i  MPS  input-  > 

♦ 

* 

♦ 

♦ 

KEYWORDS  FUR  THE  SIMPLE 

! RLGORITHM 

♦ 

CRUSH  OPTION 

1 

4 

'■  T r i e 

n uu  l .i  r i.  RRSH  on  at  l Vdi 

I rERRT IONs 

30  0 

♦ 

( 3xR<~. 

W-S  4 10  /J  ti  ilTt.  INERRS) 

PRRTIRL  price 

1 

4 

MULTIPLE  PRICE 

0 

4 

A 

< BEWRRE  - i i - not  Tia  l _f 

WEIGHT  ON  OBJECTIVE 

0 , 0 

4 

\ du  r i 

ri g rid  si  1 ) 

* 

FRCTORIZRT 1 on  fpeouehcv 

50 

4 

( i . e . 

IN"!  PT  F RF  L'l  iLHi  1 ‘ > 

CHECK  FREQ 

i'fi 

4 

< 1 i S t 

on  row  rt  i » »iuti  l * * 

SR*  IE  F-PEO 

1 0 0 

4 

< f o r 

BIT  MRP) 

LOG  FRED 

1 

4 

4 o r 

I I ERR  T I ‘.M 1 LUG  • 

SOLUTION  IF  OPT I MRL * 

INFERS I BLE  , 

OR 

UNBOUNDED 

♦ 

♦ 

FILES  FOR 

SH"ING  HMD 

LORDING  BRSIS 

DCS 

CP  I F T l ONS 

♦ 

OLD  BRSIS 

FILE 

U 

4 

•BIT  MRP ) 

NEW  BRSIS 

F ILL 

0 

4 

0 1 T MRP) 

INSERT 

FILE 

0 

4 

< I ndu  s t ►-  4 s t d nua  r i ) 

PUNCH 

1 ILL 

o 

4 

•for  sdv  i ri  3 of  INSERT  <id  t d 

LUND 

FILE 

Ij 

4 

cNRMF.S  and  UHLUb'S  • 

DUMP 

FILE 

0 

4 

V f o r S d V 1 1 1 '3  >.•  t Lilt'll.!  iid  1 d 

SOLUTION 

1 ILE 

o 

4 

v D o ri  ■ t c o n fuse  M n t r,  ►- 

r-  - 


I 


4 

♦ 

4 

♦ PARAMETERS  FOE'  MUNI  l HEAP  PROBLEM'-. 

* 

* 


PROBLEM  HUMBER 

0 

* 

r ti r n ni e 1 * f ui'P'i'li  t O' 

• t ill  r i 

Hum  HIE  HP  MAP  I ABLES 

ij 

♦ 

• OtfrtU  l t i ■ P'l  r - LI  • 

SUPERB  AS  ICS  LI  HU 

1 

4 

•:  or  MuHL  1 HEAPS.  + i ■ 

MESSIAH  DIMENSION 

I 

4 

<min<  SURERBfiS I C S < 

a i > 

COHUlJuATE  GRADIENT  HEPS  I OH 

1 

4 

4 

■ FLETCHER- PFE'.'E:-  . 

HER  I FV 

HO 

T 

* 

A. 

( Su p p ress  g raa  i e. n ' • 

LINESEARCH  TOLERANCE 

ij . 0 1 

▼ 

4 

v 1 j u 1 1.  o e d e t w t e n m . u 

ana  1 - 

REDUCED-GRAD I EHT  TOL 

ij  . L 

+ 

( d i t t o ) 

f 

♦ 

♦ 


MISCELLANEOUS 
DEBUS  LEUEL 

U * 

PRINT  LEUEL 

0 * 

IMBED 

YES  * 

A 

(Store  part  of  LU  tit-  ■ ri 

LU  ROW  TOLERANCE 

0 . U U 1 4 

( f o r i ft  i t i 4 l LIJ  lACtOt  I .a  * i 

LU  COL  TOL 

i j . 1 4 

( d i t 1 o > 

LU  MOD  TOL 

0 . 99  4 

( f o r u p d a ti  n g l U i a ■:  to  r > 

THE  FOLLOW  I MS  KEYWORDS 

EACH  ENABLE  A C 

CRT  AIN  OPTION. 

THEY  SHOULD  HOT  APPFAP 

IF  THE  OPTION  1 

S NOT  WANTED. 

ALIGNMENT  TOLERANCE 

1 . i j 4 

(Experimental,  tor  pure  lE 

CALL  CALCFG  IF  OPTIMAL 

4 

( 0 n e last  e n t r g i , i r,  r|S  | ATE 

TARGET  OBJECT  I UE  "ALUE 

0 . 0 4 

(Experimental,  tor  pare  l P > 

EMD  LIST  UF  DEFAULT  UALUES 


MOTE:  The  keywords  BEGIN  and  END  are  repaired. 
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1 II. 2 . The 

After  the  CPEOC  file  has  been  :urcessfully  read,  the  data 
specifying  the  constraint  in?- ♦ rlx  is  input  in  standard  MP3  fonnat. 

This  fonnat  is  defined  inder  the  title  "CONVERT  DAT A"  in  IBM 
document  number  3H.  '-OOCP-L,  'Mathematical  Programming  System-Ex tended 
(MP."X),  and  Generalized  Upper  hounding  (GUR) , " pp.  199-209* 
Alternatively,  see  IfM  document  number  II2G-047r>-P,  "Mathematical 
Programm  i nr  Systein/360  Version  . , Linear  and  Separable  Programming  — 
User's  Manual,"  pp.  141-151. 

The  various  sections  of  the  data  must  be  in  the  following 

order: 


NAME 

ROW:  ’ 


C0LUMN3 


RUG 

RANGES 


ROUND." 

ENDATA 


NPl^  O'  NC’y 

1.  The  relevant  column  numbers  and  contents  for  the  fields  on  each 


lata  card  are  as  follows: 


Field  1 

Field  2 

Field  3 

Field  4 

Field  5 

Field  6 

2-3 

3-12 

15-22 

25-36 

40-47 

50-61 

code 

name 

name 

value 

name 

value 
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2.  The  NAME  card  may  lefine  a name  f any  1 ingth,  beginning  In 
column  lb.  Only  the  fir.:t  8 characters  are-  saved  for  printing 
with  the  solution. 

3.  The  ROWS  section  may  define  constraints  to  tie  of  type  -,  >,  < 
or  free,  using  the  characters  E,  G,  L or  N respectively  (in 
column  1'  or  column  3).  it  is  not  essential  to  have  an  objective 
row;  thus  there  may  be  0,  1 or  more  rows  of  type  N. 

1*.  Ihe  COLUMNS  section  may  define  1 or  2 matrix  elements  per  card. 

For  nonlinear  columns,  it  is  also  acceptable  to  have  0 elements 
(i.e.,  just  the  name  of  the  variable). 

NOTE:  Nonlinear  variables  must  occur  firs  i in  the  C0L!JMNS  section, 

ordered  in  a manner  that  is  consistent  with  the  array  X 
in  the  user-written  subroutine  CALCFG. 

5.  The  RHS  section  may  contain  several  RHS's.  A specific  one  may 
be  requested  via  the  specifications,  otherwise  the  first  RHS  is 
taken. 

6.  Similarly  for  the  RANGES  section. 

7.  Similarly  for  BOUNDS.  The  types  of  bound  allowed  are  UP,  L0,  FX, 
FR,  Mi,  PL. 

Warning.:  If  a variable  is  essentially  unconstrained  the  bound 

type  FR  (free)  should  always  be  used.  Never  use  a 

large  negative  LO  bound.  Similarly  if  a variable  XI 

has  bounds  -"  < XI  < 5 (say),  then  2 cards  are  required 

as  follows : 

FR  RND1  XI 

UP  BND1  XI  5.0 


8.  The  INITIAL  bo  in1.-  .id.  'Hie  nam?  IN1TIAI  is  reserved  to  specify 
(optionally)  a special  bounds  set  which  can  be  used  to  assign 
Initial  value.:  to  nonlinear  variables.  The  INITIAL  bounds 
set  must  appear  after  any  normal  t >unds  sets  (if  any).  A warn- 
ing is  g iven  if  it  is  the  first  .set  encountered  after  the  BOUNDS 
card.  The  following  example  illustrates  the  bound  types  allowed: 


Field  1 

Field  2 

Field  ^ 

Field  4 

FX 

INITIAL 

XN1 

10.0 

IjO 

INITLAL 

XN2 

UP 

INITIAL 

XN3 

In  this  example: 

(a)  The  nonlinear  variable  XN1  will  be  initialized  at  value  10.0. 
(Its  initial  state  will  be  superbasic.)  If  10.0  lies  outside 
the  hounds  on  XN1,  the  initial  value  will  be  the  nearest 
bound . 

(b)  Nonlinear  variables  XN2  and  XN5  will  be  initialized  at  their 
lower  and  upper  bound  values  respectively.  (Their  initial 
state  will  be  nonbasic.) 

(c)  Any  nonlinear  variables  that  are  not  specified  directly  will 
initially  be  nonbasic  at  their  smallest  bound  (in  absolute 
value) . 

Note : The  INITLAL  bounds  set  provides  an  important  facility  if  used 

In  conjunction  with  CRAfH  OPTION  2 (which  prevents  nonlinear  variables 
from  being  selected  for  the  initial  basis).  By  construction,  all 


nonlinear  variables  wilL  then  be.'  either  superbasic  or  nonbasic,  and 
they  will  be  held  fixed  at  their  initial  values  while  the  remaining 
(linear)  variables  are  optimized  by  a normal  Phase  l/Fhase  2 simplex 
procedure.  Once  it  has  been  determined  that  the  associated  linear 
program  is  either  optimal  or  infeasible,  the  nonlinear  variables 
will  be  allowed  to  vary  and  optimization  will  continue  in  normal 
reduced -gradient  mode. 

It  follows  that  an  INITIAL  bounds  set  and  CRASH  OPTION  2 
should  be  used  if  good  starting  values  are  known  for  all  of  the  non- 
linear variables.  (At  least  one  FX  indicator  must  be  used  to  achieve 
the  above  effect,  and  the  SUPERBASICS  card  should  specify  a suitably 
large  number.  If  FX  is  used  for  all  nonlinear  variables,  then  CRASH 
OPTION  2 may  be  omitted.) 

If  a starting  point  is  specified  by  any  other  means  (i.e.,  via 
Oil)  BASIS,  INSERT  BASIS  or  LOAD  BASIS  cards),  the  INITIAL  bounds 
set  will  be  ignored.  This  allows  the  user  to  re-start  a run  without 
altering  the  MPS  file. 

■V'.rnlngs.  provisos,  etc. 

1.  The  constraint  matrix  is  not  scaled  by  the  program, 
should  try  to  ensure  that 

a)  all  elements  a.  . are  reasonably  close  to  1.0; 

b)  units  are  chosen  so  that  all  x.  satisfy  10 
or  x . = 0. 

These  are  by  no  means  absolute  requirements  but  are 
for  numerical  reliability  (and  to  ensure  that  there 
some  significant  figures  in  the  printed  solution). 


1 

) 


so  the  user 


< x . < 10‘ 

~ J “ 


rec  anmended 
are  at  least 


50 


P.  The  program  docs  make  allowance  for  the  scale-  of  the  objective 


function  and,  to  a lesser  extent,  the  RHS.  The  sizes  of  the 
objective  and  b.  elements  are  therefore  somewhat  less  critical. 
f>.  The  nonlinear  objective  f'inction  In  evaluated  only  at  feasible 
points.  Tiie  BOUNDS  section  should  in  general  include  bounds  on 
all  nonlinear  variables  so  that,  "feasible  points"  are  indeed 
away  from  singularities  in  the  objective  and  its  gradient, 
e.g.,  if  f(x)  = 1/XjXjp  and  it  is  known  that  x.  **  10  at  the 
solution,  it  would  be  advisable  to  include  bounds  forcing  x.  > 1 
(say) . 

III. 3.  Subroutine  CALCFG 

Computation  of  the  Objective  Function  and  its  Gradient 

Let  f(x)  be  the  nonlinear  part  of  the  objective  function, 
with  corresponding  gradient  vector  g(x).  Both  f(x)  and  g(x) 
must  be  computed  by  a subroutine  called  CALCFG,  whose  specification 
and  parameters  are  as  follows.  (Recall  that  any  linear  terms  in  the 
objective  function  may  be  included  as  part  of  f(x)  or  as  a free 
row  in  the  constraint  matrix  A.) 

Specification 

SUBROUTINE  CALCFG  (MODE,  N,  X,  F,  G,  NSTATE,  NPROB) 

IMPLICIT  INTEGER ( I -N) , REAL(A-H,  0-Z) 

DIMENSION  X(N) , G(N) . 

C 

C On  machines  with  short  word  length,  e.g.,  IBM,  Univac,  it  is 
C necessary  to  use  double  precision  floating-point.  Hence 
C IMPLICIT  HTTEGER(l-N) , RKAL*8(A-H,  0-Z) 


Pnt":  "■  tel'o 

MODI1’  (Input,  output)  A control  parameter  defining  the  type 

of  function  and  derivative  information  required. 

On  entry: 

MODE  1 me  a no  the  user  must,  assign  the  function  value 

f(x)  to  F and  the  gradient  values  g(x)  to  G(j), 

,1  i,  2,  . ..,  N,  using  the  valuer  of  X stored  in  X(.j), 

- 1,  2,  . . . , N.  (Other  values  of  MODE  not  yet  imple- 
mented. ) 

On  exit: 

If  the  user  wishes  to  terminate  solution  of  the  current 
problem,  MODE  should  be  given  a negative  value  (viz.  -1) . 
N (Input)  The  number  of  variables  involved  in  f(x). 

Note:  These  must  be  the  first  N variables  in  the 

constraint  matrix  A.  In  general,  A will  be  of  dimension 
m by  n with  N < n. 

X (Input)  An  array  of  dimension  N containing  the  current 

values  of  the  nonlinear  variables  x. 

Note : The  contents  of  X should  not  be  altered,  except 

perhaps  if  NSTATE  = 2 (see  below). 

F (Output)  The  computed  value  of  f(x). 

G (Output)  The  computed  gradient  vector  g(x).  The  user 

must  3tore  the  partial  derivative  df /Ox  . in  G(j), 

,j  - 1,  2,  ...,  N . 


i 
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(Input)  A control  parameter  informing  the  user  of  the 

current  state  of  the  optimization  process. 

NS  TAT  F - 0 if  there  is  nothin'  special  about  the  current 
entry. 

NSTATK  1 if  this  is  the  f i rs t,  entry  to  CALCFG.  'iTie 
user  may  wish  to  read  data  or  set  up  certain 
local  arrays  for  use  in  computing  1'  and  G 
during  the  present  and  subsequent  entries  to 
CALCFG. 

NSTATE  = 2 if  the  current  solution  in  X is  optimal. 

The  user  may  wish  to  perform  alditional  compu- 
tations on  X. 

Notes  about  entry  with  N.  'I'ATK  --  2 

1.  This  will  occur  only  if  the  user  includes  a card  of 
the  form 

CALL  OBJECTIVE  WHEN  OPTIMAL 
in  the  problem  specifications. 

2.  This  will  be  the  last  entry  to  CALCFG. 

3.  The  entry  will  not  occur  if  iterations  are  terminated 
before  optimality  is  recognized. 

U.  The  entry  will  be  made  before  the  solution  is  output 
to  the  printer  and/or  the  Solution  File.  Any  changes 
to  the  nonlinear  variables  X will  therefore  appear 
in  the  solution  output.  (For  example,  one  might  wish 
to  round  the  elements  of  X to  the  nearest  integer.) 


NPROB 


(input)  • An  integer  which  can  be  net  by  the  user  via  a 
card  of  the  form 


PROBLEM  NUMBER  5 

in  the  problem  specifications.  This  parameter  may  be 
used  to  branch  to  one  of  several  function  calculations 
within  CALCFG.  The  user  may  ignore  it  or  use  and  change 

it  as  desired. 

III.U.  BASIS  Files 

Four  distinct  methods  are  available  for  loading  and  saving 
basis  descriptions/  They  are  invoked  by  SPECS  cards  of  the  following 
form.  (Just  one  option  per  card.  The  file  numbers  may  be  whatever 
the  user  chooses.) 


loading  Saving 


OLD  BASIS 

FILE 

10 

NEW  BASIS 

FILE 

11 

INSERT 

FILE 

20 

PUNCH 

FILE 

21 

LOAD 

FILE 

30 

DUMP 

FILE 

31 

CRASH  OPTION  0 

, 1 or  2 

SOLUTION 

FILE 

50 

The  keywords  OLD,  INSERT,  LOAD  are  mutually  exclusive.  If  more 
than  one  positive  file  number  is  specified,  the  order  of  precedence 
is  that  just  given.  If  no  starting  files  are  specified,  one  of  the 
CRASH  options  takes  precedence. 

The  keywords  NEW,  PUNCH,  DUMP,  SOLUTION  may  all  specify 
positive  file  numbers.  Hence  from  zero  to  four  files  may  be  created 
at  the  end  of  a run,  in  the  order  just  given.  In  addition,  a NEW 

*See  also  the  INITIAL  bound;:  set  in  Section  III. 2. 
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IiAi' I KILE  may  he  created  every  k iterations  during  a run,  where 
k is  specified  by  a CAVE  FRKQUEN< 'Y  card. 

Normally  the  various  basis  files  or-  used  In  the  following 
circumstances.  Fuller  ietailr  are  given  in  Section  V. 

1.  OLD /NEW  t -it  map.  This  is  the  most  compact  and  efficient  method 
for  starting  from  an  earli  ,-r  run  on  eith  r the  :ame  problem  or 
one  of  the  same  dimes,  ions. 

2.  INSERT /PUNCH.  This  provides  compatibility  with  certain  commercial 
systems  (e.g.,  MPS/3K0,  MPSX/370,  MPS  III,  APEX).  The  PUNCH 
file  from  a particular  problem  can  be  used  as  an  INSERT  file 
for  restarting  solution  of  the  same  problem.  Occasionally  it 

imy  be  possible  to  modify  the  INSERT  file  and/or  the  problem 
and  still  obtain  a useful  advanced  basis. 

The  standard  MPS  format  has  been  slightly  generalized  within 
MINOS  to  allow  saving  and  reloading  of  nonbasic  solutions. 

3.  LOAD/DUMP.  This  is  similar  in  vein  to  INSERT/PUNCH  but  allows 
more  direct  specification  of  a list  of  basic  and  superbasic 
variables  (both  structural  and  logic  a Is)  and  their  desired  start- 
ing values.  It  is  usually  easier  to  ensure  that  a DUMP  file 
(rather  than  a PUNCH  file)  lr  suitable  for  restarting  a modi- 
fied problem. 


* So-called  because  each  variable  Is  represented  by  just,  one  character. 
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U . SOLUTION  file.  This  may  be  used  to  communicate  solution  values 
(e.g.,  x,  it,  objective  gradient,  bounds)  to  another  program  for 
further  computation.  It  uses  essentially  the  same  format  as 
that  used  for  the  printed  solution.  For  greater  precision  it 
uses  format  1PE16.6  for  all  values,  rather  than  FI6.5. 


n 

n 

n 

o 


TV.  PmiT-M i Spec  i p Ic a ' i on: ; 

IV.  1.  The  SPECS  file  — S:vnta.< 

Erich  card  in  the  SPEC’S  file  must  be  of  the  form 


(keyword)  (identifier)  (idlist)  (number)  (comment) 


where  items  may  be  written  in  free  format  with  one  or  more  blanks  or 
'='  s as  separators.  Tn  general  (depending  on  (keyword))  not  all 
items  need  be  present. 


(keyword)  A string  of  non-blank  characters  beginning  anywhere 

in  columns  1 through  TO.  A keyword  is  defined  by  its 
first  3 characters;  any  others  are  ignored, 
(identifier)  A list  of  8 consecutive  characters,  the  first  of 

which  is  any  non-blank  character  except  the  following, 
which  are  hereby  defined  to  be  numeric  characters: 

0123^56789  + - 


Valid  use  of  identifiers: 
OBJECTIVE  = COST  ROW 
RHS  = ...Z. 


RANGES  - RNG001 

BOUNDS  = L0W1.E-5 


Invalid  use  of  identifiers: 
OBJECTIVE  = -Z 
BOUNDS  = 2Q 
BOUNDS  = 1.0E-7 
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Note  that  blanks  may  be  imbedded  in  the  last  7 


{ idlist) 


(number) 


characters,  but  the  same  blanks  must  then  appear 
in  the  corresponding  MPS  data  cards. 

A list  of  items  separated  by  blanks  or  ’='  s.  The 
first  character  of  each  item  is  not  one  of  the  numeric 
characters  listed  above.  All  items  in  the  list  are 
ignored. 

Valid  use  of  idlist: 

WEIGHT  ON  OBJ  (DURING  PHASE  ONE)  = 100.0 
Invalid  use  of  an  idlist: 

WEIGHT  ON  OBJ  (DURING  PHASE  l)  = 100.0 
A list  of  up  to  8 consecutive  characters,  the  first 
of  which  is  numeric.  The  number  may  be  either  an 
integer  or  a real  constant.  It  will  be  treated  as  an 
integer  if  all  remaining  characters  are  numeric;  it 
should  then  be  typed  in  I format. 

Valid  use  of  integers: 

ROWS  = 2000 

COLS  = +2000 
Invalid  use  of  integers : 

ROWS  = 1.0E+3 

A number  will  be  treated  as  a real  if  any  character 
other  than  the  first  is  'E'  or  'D'j  it  should 

then  be  typed  in  F,  E or  D format . 
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V i i i i ure  of  refi  1:.. : 


ALT  TO. .FRANCE  = 0.00001 

WEIGHT  ON  OBJ  - +1.0E+5 
LOWER  BOUND  - -1.0D+30 
Invalid  use  of  real.? : 

TOWER  BOUND  = .IE- 5 

(comment)  banning  of  a specification  card  is  terminated  under 

the  following  conditions: 

1.  if  the  first  non-blank  character  is  an  (i.e., 
if  the  first  character  in  the  keyword  is  an 
?.  if  any  blank  or  '=*  is  followed  by  an 
3.  If  an  integer  or  a real  has  been  recognized. 

Hence  a comment  may  be  any  characters  following  an 
or  an  integer  or  a real. 

Valid  use  of  comments 
* 

OBJ  = COST  02  * 2ND  ALTERNATIVE 

ROWS  1000  (OR  LESS) 

WEIGHT  ON  OBJ  = 10.0  IN  PHASE  1 

IV.?.  The  SPECS  file  — Keywords 

The  following  is  an  alphabetical  list  of  recognized  keywords. 
A typical,  use  of  each  keyword  is  given,  along  with  a definition  of 
the  quantities  involved  and  various  comments  or  warnings.  In  many 
cases,  the  value  associated  with  a keyword  is  denoted  by  a letter 
such  as  k,  and  allowable  values  for  k are  subsequently  defined. 
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• AIJ  TOLKRANCE 


O.OOl 


During  input  of  the  MPS  file,  matrix  coefficients  a^.  will  be 
ignored  if  | a ^ j|  is  less  than  or  equal  to  the  specified  tolerance. 

• ALIGNMENT  TOLERANCE  1.0 

A parameter  invoking  a certain  algorithmic  option  which  affects 
the  search  direction  used  for  superbasic  variables.  Specifically, 

a subset  of  the  superbasics  is  selected  such  that  each  member  x . 

J 

is  close  to  its  one  of  its  bounds  and  has  a significant  gradient 
component  moving  Xj  towards  that  bound.  The  search  direction  is 
scaled  in  a way  that  will  cause  all  members  of  the  subset  to  reach 
their  bounds  simultaneously.  All  members  will  therefore  be  "squeezed" 
out  of  the  superbasic  set,  unless  a basic  variable  happens  to  reach 
a bound  first. 

1.  The  ALIGNMENT  keyword  should  not  appear  if  alignment  is  not 
required . 

2.  Alignment  is  unlikely  to  be  successful  on  nonlinear  problems. 

J.  Use  of  the  specified  tolerance  depends  on  the  particular  version 
of  subroutine  ALIGN. 

• BOUNDS  BOUNDOl 

The  8-character  name  of  the  bound  set  to  be  selected  from  the  MPS  file. 

1.  BNDS  is  a valid  alternative  keyword. 

2.  If  no  BOUNDS  keyword  exists,  or  if  the  name  specified  is  blank, 
the  first  bound  set  in  the  MPS  file  will  be  selected. 

3.  If  the  MPS  file  contains  one  or  more  bound  sets,  but  the  user 
wishes  rjo  bound  set  to  be  used,  some  dummy  name  should  be  specified, 
e.g.,  BOUNDS  = NONE. 

i<0  | 
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• .'A  LI  Or :-T ECT IV.K  WHEN  OPTD.1AI 

This  requests  a final  call  to  the  user'.;  subroutine  CAI/iFG  when 
(ant  if)  an  optimal  solution  hat;  been  obtained. 

1.  Refer  to  the  parameter  "NSTATE"  in  Section  III.  "5 . 

2.  The  'ALL  keyword  should  not  appear  if  a final  call  is  not 
requ i red . 

• 1ECK  FREQUENCY  k 

The  residual  vector  r - b - s - Ax  will  be  computed  every  k-th 
Iteration.  Refactorization  of  the  current  basis  B is  requested 
if  ||D*1r||  is  too  large,  where  D • diag(d.)  and  d.  is  the  largest 
element  in  the  i-th  row  of  B.  Normally  k should  be  about  2‘j  or 
half  the  FACTORIZATION  FREQUENCY . 

• COEFFICIENTS  .-'000 

See  ELEMENTS. 

• COLUMN.'  1000 

An  over-estimate  of  the  number  of  columns  in  the  constraint  matrix 
(excluding  slack.1) . i)efault  is  3m  where  m is  specified  by  the 
HOWS  card. 

• CONJUGATE  ORAL I ENT  VERSION  k 

This  specifies  which  version  of  the  method  of  conjugate  gradients 
should  be  used  if  there  is  not  enough  storage  available  (via  the 
HESSIAN  Keyword)  for  the  usual  quasi-Newton  method. 

k Conjugate  gradient  algorithm 

1 Fletcher  and  Reeves  (1961) 

2 Polak  and  Ribiere  (1969) 

3 Perry  (1976) 

h Memoryless  DFP 

5 Memory leas  Complementary  DFP 

kl 


Further  discussion  is  given  in  Section  1 1.2. 


• CRASH  OPTION  k 

This  determines  which  columns  of  [A  Ii  are  to  he  considered  for 
construction  of  an  initial  basis  !• 


k Meaning 

0 The  all-slack  basis  B = I is  set  up. 

1 All  columns  of  A are  considered  (except  those  correspond- 
ing to  nonlinear  variables  which  have  been  initialized 

in  the  MPS  data  at  values  away  from  their  bounds  — see 
Section  III. 2 ).  This  is  the  default  option. 

> 2 'The  columns  of  A corresponding  to  linear  variables  will 

be  considered  (same  as  k = 1 if  the  problem  is  purely 
linear) . 

In  all  cases  the  initial  basic  is  chosen  to  be  strictly  triangular 
without  regard  to  feasibility  or  optimality. 

1.  The  CRASH  option  is  ignored  if  a starting  basis  is  specified. 

• DEBUG  LEVEL  k 

Various  positive  . a lues  of  k cause  various  amounts  of  additional 
information  to  lie  printed. 

« DUMP  FILL  k 

If  k > 0,  the  last  solution  obtained  will  be  output  to  file  k in 
the  format  described  in  Section  V. 3.  Variables  are  listed  by  state, 
name  and  value. 


hP 


• ELEMENTS 


5000 


An  over-  stimate  of  the  number  of  nonzero  elements  (coefficients, 

a..)  in  the  constraint  matrix. 

LJ 

1.  COEFFICIENTS  is  a valid  alternative  keyword. 

2.  The  default  value  is  5n  where  n is  specified  by  the  COLUMNS 
card. 

• ERROR  MESSAGE  LIMIT  50 

The  maximum  number  of  error  messages  to  be  printed  for  each  type  of 
error  occurring  during  input.  (Should  be  large  for  early  runs  on  a 
particular  MRS  deck.  Can  be  lowered  to  suppress  warning  of  non-fatal 
errors  during  multiple  subsequent  runs.) 

• FACTORIZATION  FREQUENCY  k 

At  most  k iterations  will  occur  between  factorizations  of  the  basis. 

1.  INVERT  is  a valid  alternative  keyword, 

2.  Normally  k should  be  around  50  or  60.  Values  larger  than 
100  should  almost  never  be  used. 

• HESSIAN  DIMENSION  k 

This  specifies  that  a k * k upper-triangular  matrix  R is  to  be 
available  for  use  by  the  quasi-Newton  algorithm,  as  a means  of 
approximating  the  reduced  Hessian  matrix.  Suppose  that  there  are 
ns  superbasic  variables  at  a particular  iteration. 


1*1 


1.  If  ns  < k,  the  first  ns  columns  of  R will  be  used,  although 
a constant  k(k  + l)/2  words  of  storage  are  allocated  from  the 
beginning. 

2.  The  storage  for  R is  substantial  if  k is  as  large  as  100 
or  200.  In  general,  k should  be  a slight  overestimate  of  the 
final  number  of  superbasic  variables.  If  the  number  of  nonlinear 
variables  in  the  objective  is  nn  then  k need  not  be  lagger 
than  nn  + 1. 

3.  If  ns  exceeds  k the  quasi-Newton  algorithm  is  discontinued 
in  favor  of  a conjugate-gradient  algorithm.  The  matrix  R is 
not  used  until  ns  decreases  to  the  value  k. 

k.  The  default  value  for  k is  n,  where  n is  specified  by  a 
SUPERBASICS  cord,  or  0 if  the  problem  is  linear. 


• IMBED 

YES 

IMBED 

NO 

Determines  whether  part  of  the  LU  factorization  of  the  basis  is  to 
be  imbedded  in  the  constraint  matrix  A. 

1.  If  YES  (the  default),  any  non-spike  column  in  B will  be 
referenced  in  the  L file  by  a single  pointer  to  the  appropriate 
column  of  A. 

2.  If  NO,  any  non-spike  column  will  be  copied  into  the  L file. 
Ihi3  will  increase  the  storage  required  for  L but  in  general 
will  reduce  paging  activity  on  a machine  with  virtual  memory. 
Execution  speed  may  therefore  increase. 


I 

f 


• INP'n‘  FILE 


k 


The  file  number  for  the  MPS  data  file.  The  default  value  (k  = 5) 
refers  to  the  card  input  stream. 

• INSERT  FILE  k 

References  a file  containing  basis  information  in  the  format  described 
in  Section  V.2. 

1.  Uses  data  produced  on  a PUNCH  file. 

: . Will  be  ignored  if  a positive  OIL  BASIS  FILE  is  specified. 

• INVERT  FREQUENCY  k 

See  FACTORIZATION  FREQUENCY 

• ITERATIONS  k 

An  upper  limit  on  the  number  of  iterations  allowed. 

1.  ITNS  is  a valid  alternative  keyword. 

2.  k = 0 is  valid)  feasibility  is  cheeked  but  optimality  is  not. 

3.  The  default  value  is  3m  + lOnn  where  ra  and  nn  are  specified 

by  ROWS  and  NONLINEAR  VARIABLES  respectively. 

• LINES EAR CH  TOLERANCE  t 

For  nonlinear  problems,  this  controls  the  accuracy  with  which  a 
minimum  of  the  objective  function  will  be  located  along  the  direction 
of  search  each  iteration. 

1.  t must  be  a real  number  in  the  range  0.0  < t < 1.0. 

2.  Smaller  values  of  t,  generally  result  in  more  evaluations  of 

the  objective  function  but  fewer  total  iterations. 
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3.  The  default  value  t = 0.01  requests  a fairly  accurate  search, 
on  the  assumption  that  the  total  work  per  iteration  is  large 


relative  to  the  work  required  in  evaluating  the  objective  function, 
t.  If  the  objective  is  expensive  to  evaluate,  t should  be  in  the 
range  0.1  to  0.9  (say). 

3.  The  lineseareh  procedure*  'uses  t in  the  following  way.  If  d 
is  the  current  search  direction  and  g(x  + ad)  is  the  objective 
gradient  at  a step  a along  direction  d,  then  the  point  x + ad 
will  be  accepted  as  an  improvement  over  the  point  x if 


g(x  + ad)Tl 
g(x)Td 


< t 


• LIST  LIMIT  100 

The  maximum  number  of  lines  of  MPS  data  to  be  listed  during  input. 

(The  header  cards,  i.e.,  NAME,  ROWS,  COLUMNS,  RHS,  RANGE,  BOUNDS, 
ENDATA,  will  always  be  listed  along  with  their  position  in  the  MPS 
deck. ) 

• LOAD  FILE  k 

References  a file  containing  basis  information  in  the  format  described 
in  Section  V.3. 


1.  Uses  data  produced  on  a DUMP  file. 

?.  Will  be  ignored  if  a positive  OLD  BASIS  FILE  or  INSERT  FILE 
Is  specified. 


* MINOS  uses  subroutines  LNSFCH  and  NEWPTC  from  the  NPL  Algorithms 
Library.  See  Gill,  Murray,  Ptcken,  Barber  and  Wright  (1976). 
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• LOG  FI  EQUENCY 


K 


One  line  of  the  iteration  Log  will  be  printed  every  k-th  iteration, 
k 10  or  20  is  suggested  Tor  those  Interested  only  in  the  final 
solution. 

• T.OWER  POUND  b 

The  default  lower  bound  to  be  set  on  all  structural  variables  before 
any  bound  set  is  input  from  the  MP3  file. 

1.  May  be  useful  for  bounding  a Li  variables  away  from  singularities 
in  the  objective.  (Other  explicit  bounds  may  also  be  necessary.) 

2.  If  all  or  most  variables  are  to  be  FREE,  the  negative  value  b = 
-1.0E+30  (or  less)  may  be  used  to  specify  "minus  infinity." 

« LU  RCW  TOLFRANCE  t 

LU  COL  TOLERANCE  t 

LU  MOD  TOLERANCE  t 

Tolerances  for  computing  and  updating  L(J  factors  of  the  basis.  See 
Section  VIII. 

• MAX  MIZE 
MINIMIZE 

The  required  direction  of  optimization  (MIN  is  default).  This 
applies  to  both  linear  and  nonlinear  terms  in  the  objective. 

• MULTIPLE  PRICE  k 

If  k > 0,  this  over-rides  the  PARTIAL  PRICK  parameter. 

L.  Whenever  a PRICE  operation  Is  performed,  the  k best  nonbasic 
variables  will  be  selected  for  admission  to  the  3uperbasic  set. 
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Warning : If  k > L,  this  puts  MINOS  into  "reduced  gradient" 

mode  even  on  purely  linear  problems.  The  subsequent  iterations 


do  not  correspond  to  the  very  efficient  "Minor  Iterations" 
carried  out  by  standard  LP  systems  using  multiple  pricing.  (All 
superbasics  will  be  varied  simultaneously.  Note  however  that 
total  storage  requirements  are  independent  of  k;  hence  k 
need  not  be  limited  to  5 or  6 as  it  is  in  standard  LP  systems, 
which  require  k vectors  of  dimension  m.) 

3.  On  very  large  nonlinear  problems  it  may  be  important  to  use  quite 
a large  value  of  k for  the  first  few  hundred  or  thousand  itera- 
tions, as  a means  of  "getting  a lot  of  variables  going"  quickly. 
For  example,  if  a problem  has  3000  variables  and  500  of  them 
are  nonlinear,  the  optimal  solution  may  well  have  200  or  more 
variables  superbasic.  If  the  problem  is  solved  in  several  runs, 
it  may  be  beneficial  to  use  k = 10  or  20  (say)  for  early 
runs,  until  it  seems  that  the  number  of  superbasics  has  levelled 
off. 

4.  '(lie  default  strategy  (no  partial  or  multiple  pricing,  add  one 
variable  at  a time  to  the  superbasics)  appears  in  practice  to  be 
preferable  once  a near-optimal  solution  has  been  obtained.  This 
is  partly  because  the  projected  Hessian  approximation  for  s 
superbasics  Is  likely  to  be  improved  more  quickly  for  an  expanded 
set  of  s + k superbasics  if  k is  only  1. 
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. MULTIPLE  PRICE  L has  a slightly  different  effect  from  PARTIAL 
PRICE  1,  MULTIPLE  PRICK  0,  even  though  just  1 superbasic  is 


added  at  each  PRICE  operation.  For  linear  problems,  the 
reduced-gradient  mode  of  operation  is  slightly  less  efficient 
than  the  simplex  algorithm.  For  nonlinear  problems,  the  method 
of  updating  the  reduced  Hessian  approximation  differs.  With 
MULTIPLE  PRICE  1,  the  triangular  matrix  R Is  expanded  to 
dimension  oil  by  appending  the  unit  vector  eo^.  (Similarly 
if  k > 1,  k unit  vectors  are  added.)  Otherwise  an  attempt  is 
made  to  obtain  a better  approximation,  using  some  finite-difference 
technique. 

• NEW  BASIS  FILE  k 

If  k > 0,  a hit  map  will  be  saved  on  file  k every  j-th  iteration, 

where  J is  the  specified  SAVE  FREQUENCY. 

1.  The  first  caivi  of  the  file  will  contain  the  word  PROCEEDING 

if  the  current  run  is  still  in  progress  (see  Section  V.l). 

2.  A hit  map  will  also  be  saved  at  the  end  of  a run  (if  k > 0) . 

3.  'Ibis  is  the  only  basis  file  affected  by  the  SAVE  FREQUENCY 

parameter. 

• NONLINEAR  VARIABLES  N 

This  specifies  that  the  first  N variables  in  the  constraint  matrix 

and  made  available  as  the  array 


1.  If  N = 0,  the  problem  is  a linear  program. 

2.  Not  all  N variables  need  be  explicitly  involved  in  the  non- 
linear objective.  For  example,  some  of  them  may  be  FIXED  at 
permanent  values.  Note  however  that  gradient  values  G(j) 
must  be  supyjlied  for  all  j 1,  ...,  N.  The  correct  value  is 

0.0  if  variable  j is  essentially  a linear  variable,  or  c . 

J 

if  the  linear  term  c.x.  is  not  already  included  in  the  linear 
objective  row. 

3.  In  some  cases  it  is  convenient  to  regard  even  the  logical  variables 

as  nonlinear  (e.g.,  in  solving  the  linear  c onplementar ity  problem: 

T T 

min  z w subject  to  w =•  Mz  + q,  z w = 0,  z > 0,  w > 0.  Hus 

problem  should  be  entered  as  a linear  program  of  the  form 

Mz  > -q,  z > 0,  so  that  the  "slack  variables"  may  serve  as  -w.) 

The  value  of  N should  then  be  n + 1 + m fallowing  1 for 
the  RHS) . 


• OBJECTIVE  COST 

The  8-character  name  of  the  free  row  to  be  used  as  the  linear  part 

of  the  objective  function. 

1.  If  no  OBJECTIVE  card  exists,  or  if  the  name  specified  is  blank, 
the  first  free  row  will  be  selected. 

2.  If  there  ate  no  free  rows,  or  if  the  user  (perhaps  intentionally) 
specifies  a non-existent  OBJECTIVE  name,  optimization  will 
terminate  at  the  first  feasible  solution  (unless  a nonlinear 
objective  exists). 
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If  a 

i online Jir  objective 

function  i.r;  of 

the  form 

f(xN)  -t  c X 

w.neiv 

X j-  ) (.£> 

partitioned  into 

nonlinear  and  linear 

variables  respectively. 

the  elements  of 

c may 

be  specified 

in  several  alternative 

T 

ways.  let  c x 

T 

Vn  + 

c|x  j . Then 

(a) 

all  of  c may  be 

if  i<  • th  j 

OBJ  row  of  the  MPL 

deck; 

(b) 

T 

if  CjjXj.  hai 

■ ■ ■ • L ii 

ub routine 

CALCFG  as 

part  oi  the  funeti 

. , 

only  Cj 

should  be 

rpecified  in  the  MPL  file; 

(c) 

either  c.T  or  eT 
N L 

or  both  may  be 

absent . 

• OLD  BASIS  FILE  k 

Specifies  a bit  map  to  be  used  for  the  starting  solution  (see  Section 
V.  1) . 

1.  k > 0 takes  precedence  over  an  INSERT  file  or  a 1DAD  file. 

• PARTIAL  PRICE  k 

The  matrix  A will  be  livided  into  k equal  partitions  k,.)t  . ..,  A^. 
for  the  purposes  of  selecting  a column  to  enter  the  basis.  Normally 
one  partition  A^.  will  be  priced,  along  with  all  of  the  slacks. 

1.  ALmost  always  k should  be  set  to  1,  unless  i is  large  and 
m « n,  where  A is  m by  n.  The  default  value  is  k = 1. 

2.  Pricing  stops  if  a variable  in  A.  or  a slack  variable  has  a 
favorable  reduced  gradient  (as  judged  by  a dynamic  tolerance). 

3.  The  next  pricing  starts  with  partition  ]<)• 
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• PROBLEM  NO. 


3 


For  nonlinear  probJems,  this  allows  the  user  to  set  the  parameter 
"NPROB"  in  subroutine  CALCFG.  See  .‘lection  III.  3. 

• PUNCH  FILE  k 

If  k > 0,  the  final  solution  obtained  will  be  output  to  file  k 
in  the  format  described  in  Section  V.2.  For  linear  problems,  this 
format  is  compatible  with  various  commercial  systems. 

• RANGES  RANGE001 

The  8-character  name  of  the  range  set  to  be  selected  from  the  MPS  file. 

1.  RNG  (or  RNGS)  are  valil  alternative  keywords. 

2.  For  multiple  RANGE  sets,  see  notes  2 and  3 under  keyword 
BOUNDS  and  interpret  appropriately. 

] 

• REDUCED  GRADIENT  TOLERANCE  t 

For  nonlinear  problems,  this  controls  the  extent  to  which  optimiza- 
tion is  restricted  to  the  current  set  of  basic  and  superbasic  variables 
(i.e..  Phase  b iterations),  before  a new  nonbasic  variable  is  added 
to  the  superbasic  set  (Phase  3) • 

1.  t must  be  a real  number  in  the  range  0.0  < t < 1.0.  The 
default  value  is  t = 0.2. 

2.  Smaller  values  of  t generally  result  in  more  iterations, 
larger  values  may  be  satisfactory,  particularly  when  the  current 
solution  is  far  from  optimal. 


Not,'- : This  parameter  Joes  n >1  r "or  to  th-.  absolute  size  of  the 

re iuced  jradienl  •••  any  stag  . Ls  i t . for  requesting 

iterations  to  terminate  Mien  the  re-lured  gradient  reaches  a 
certain  value. 

4.  t is  used  in  the  following  way.  Whenever  a variable  x.  is 

added  to  the  superbasic  set  the  norm  of  the  reduced-gradient 

vector  (for  all  superbasics)  is  recorded.  Let  this  lie  ii  g ||. 

Usually  j|  r.  II  -•  I d .1  , where  d . is  the  "reduced  cost"  for 
0 J J 

the  new  superbasic.  Subsequent  Phase  4 iterations  will  continue 
at  least  until  the  norm  of  the  reduced-grad ient  vector  satisfies 
il  g II  < t j|  ? | . (Other  convergence  tests  may  cause  further 
Phase  4 iterations.) 

• p HS  RHSIDE1 

The  8-charact.er  name  of  the  rhs  vector  to  be  selected  from  the 
MP3  data. 


1.  3ee  notes  2 and  3 under  BOUNDS. 

2.  If  no  rhs  exists  after  input  (perhaps  after  deletion  of  small 
coefficients),  a dummy  zero  vector  is  constructed. 

• ROWS  500  . 

An  over-estimate  of  the  number  of  rows  in  the  constraint  matrix. 

1.  If  m is  the  number  specified,  the  size  of  the  hash  table  used 
to  hold  the  row  names  will  usually  be  2m.  The  number  of  colli- 
sions (and  hence  total  input  time)  may  in  general  be  reduced  by 
specifying  m to  be  larger  than  necessary  (within  reason). 
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• SAVE  FREQUENCY  k 

Suppose  the  NEW  BASIS  FILE  card  specified  m file  number  f.  If 
f > 0 and  k > 0,  a bit  mop  describing  the  current  solution  will 
be  saved  >n  file  f every  k-th  iteration. 

• SOLUTION  w 

Determines  whether  a solution  is  to  be  printed  on  file  6 and/or 
output  to  a specified  file,  ar:  follows: 


w 

YES 


NO 

IF  OPTIMAL 


FILE  k 


Mean i nr 

The  last  solution  obtained  will  be  printed  on  file 
6 (whether  optimal  or  not). 

The  solution  will  not  be  printed. 

The  solution  will  be  printed  only  if  it  has  been 
determined  to  be  optimal,  or  if  the  problem  appears 
to  be  infeasible  or  unbounded. 

If  k > 0 the  last  solution  obtained  will  be  out- 
put to  file  k (whether  optimal  or  not). 


1.  If  w is  blank  or  is  anything  other  than  YES,  NO  or  FILE  it 
will  be  treated  as  IF  OPTIMAL. 

2.  The  first  3 options  (YES,  NO,  IF  OPTIMAL)  may  co-exist  with 
the  FII£  option. 

3.  For  the  1st  and  3rd  options,  floating-point  numbers  are  printed 
with  F16.5  format,  and  "infinite"  upper  or  lower  bounds  are 
denoted  by  t.he  word  NONE. 

5^ 


I 

:i 

1 


1 

1 

i 

1 

1 


\ »• 


U.  For  the  FILE  opt  ion,  the  format  ued  is  1PK16.6  for  all 
numbers,  including  "infinite " bounds  which  will  appear  as 
+1.000000E+30. 

r, . Since  the  pz’inter  is  fib-  6,  the  specifications 

SOLUTION  NO 

SOLUTION  FILE  6 

may  be  used  together  to  obtain  E-format  in  the  printed  solution 
( e.g .,  if  7 significant  digits  are  required  for  all  numbers). 

• SUPERBASICS  ns 

Spec  if ies  how  many  superbasic  variables  ore  to  be  allowed  for.  Should 
be  used  in  conjunction  with  a "HESSIAN  DIMENSION"  card. 

1.  In  some  sense,  ns  measures  the  expected  deviation  from  linearity. 

2.  Normally  ns  need  not  be  greater  than  nn  + 1 where  nn  is 
the  specified  number  of  nonlinear  variables. 

3.  For  certain  problems,  ns  may  be  considerably  smaller  than  nn. 
This  is  important  if  nn  is  very  large. 

• TARGET  OBJECTIVE  VALUE  t 

This  keyword  invokes  a certain  optimization  technique,  and  also  sets 
the  value  of  t.  In  effect  it  forces  the  solution  at  each  iteration 
to  be  regarded  as  infeasible  if  the  linear  objective  row  has  not 
yet  reached  the  value  t.  This  is  designed  to  take  advantage  of  the 
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a pec  ini  pivot-row  selection  procedure  (OHUZR)  due  t o D.C.  Rnrick 
(1975)*  which  minimizes  the  sum  of  infeasibi llties  fit  each  itera- 
tion without  concerning  itself  with  the  number  of  infeasibilities. 

1.  TARGET  has  no  effect  if  there  in  no  linear  objective. 

The  value  of  t should  take  into  account  the  direction  of 
optimization  (MIN  or  MAX) . 

I ' is  generally  unwise  to  invoke  targeting  unless  t is  known 
a priori  to  be  sub-optimal. 

4.  if  the  problem  appears  to  be  infeasible,  targeting  is  disabled 
and  optimization  continues  normally. 

5.  Stay  clear  unless  you  know  what  you  are  doing. 

• UPPER  BOUND  b 

The  default  upper  bound  to  be  set  on  all  structural  variables 
before  any  bound  set  is  input  from  the  MPS  file. 

1.  A value  of  1.0E+50  or  greater  will  be  interpreted  as  "plus 
infinity."  This  is  the  default  value  and  therefore  need  not 
be  set. 

• VERIFY  w 

Determines  whether  or  not  the  computed  gradient  vector  from  the 
user's  subroutine  CALOFG  is  to  be  checked  numerically.  If  w 
is  the  word  NO,  the  gradient  will  not  be  checked.  Any  other  value 
of  w is  equivalent  to  YES.  Checking  will  be  performed  at  the 
first  feasible  point  found.  Finite  differences  are  taken  of  the 
objective  value  along  two  orthogonal  directions.  (If  necessary, 
the  directions  will  be  modified  to  avoid  stepping  outside  the 
feasible  region.)  The  default  value  of  w is  NO. 


Fhis  yword  Lnv  the  io-c  L]  i ■ ggjgog it-  technique, 

if  the  flr.it  solution  ob'iinnl  fnfeasibl-  • The  method  attempts 
to  optimize  the  true  objective  f one t ion  (linear  terms  only)  while 
■'  : ! ■.  reducinj  he  sum  of  infeasibilities. 

1.  The  oh. i'-'t  rve  function  is  ie fined  at  each  infeasible  iteration 
to  be 

T 

min  mw(c  x)  + (s'lm  of  infeasibilities) 

where  m 1 for  MIN,  -1  for  MAX,  and  c is  the  linear 
objective  row. 

2.  If  the  sum  of  infeasibilities  can  not  be  reduced  at  some  stage, 
w is  reduced  by  a factor  of  10.  This  helps  to  allow  for  the 
possibility  that  the  w specified  by  the  user  is  too  large. 

It  also  provides  dynamic  allowance  for  the  fact  that  the  sum  of 
infeasibilities  is  tending  towards  zero. 

5.  The  effect  of  w is  disabled  after  5 such  reductions  of  w, 
or  if  a ftasible  solution  is  obtained. 
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V.  Basis  File  Formats 


Figures  l through  1+  illustrate  tlv-  data  formats  used  for 
the  various  basis  files  introduced  in  faction  1II.1.  Selected  column 
number  ■ are  included  to  define  the  significant  data  fields.  The 
logical  records  in  each  file  are  alphanumeric  data  with  the  following 
record  lengths: 

F i le  Logical  record  length 


OLD/NEW  bit  map 

8o 

punch/insert  file 

36 

DUMP/IjOAD  file 

36 

SOLUTION  FILE 

108 

(Larger  record  lengths  may  be  used  for  convenience,  e.g.,  80,  80,  80, 
133  respectively.) 

The  files  shown  correspond  to  the  optimal  solution  for  a 
small  but  non-trivial  example,  namely  the  Weapon  Assignment  problem 
in  Himmelblau  (1972),  problem  23*  This  is  of  the  form 

20  5 x.  . 

minimize  Z u.(  II  a.1/1  - 1) 
j=l  J i=l  1J 

subject  to  Ax  ^ b,  x > 0 

where  A ha3  dimensions  i2  * loo. 

7.1.  Oil)  / NEW  Basis  F.les  (bit  maps) 

A bit  map  is  primarily  intended  for  restarting  the  solution 
of  a problem  at  a point  that  was  readied  by  an  earlier  run,  either 
on  the  same  problem  or  on  a related  problem  of  the  same  dimensions. 
e.g.,  one  which  has  a different  OBJECTIVE,  RHS,  RANGE  or  BOUND 
set  or  different  matrix  coefficients. 
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F j qij.  re  t,  F o rrrie 


The  Information  saved  Is  very  compact  (but  rather  difficult 


to  modify).  With  some  computer  systems  Lt  is  possible  to  access 
the  bit  map  at  occasional  intervals  during  a run;  in  such  cases  the 
first  card  of  the  file  will  provide  a useful  glimpsq  of  the  run's 
progress  so  far. 

As  illustrated  in  Figure  1,  the  information  contained  in 
an  OLD  or  NEW  BASIS  FILE  is  as  follows: 

1.  A card  containing  the  problem  name,  iteration  number,  current 
status  (OPTIMAL  SOLN,  INFEASIBLE,  UNBOUNDED,  EXCESS  ITNS, 

ERROR  CONDN,  or  PROCEEDING),  current  phase  and  current  objective 
value  or  sum  of  tnfeasibilities. 

2.  A card  containing  the  OBJ,  RHS,  RNG  and  BND  names,  M = no. 
of  ro»3  in  the  constraint  matrix,  N = total  no.  of  variables, 

SB  = current  no.  of  superbasics.  In  thi3  context, 

N - n + 1 + m 

where 

(a)  the  first  n variables  are  those  in  Aj 

(b)  variable  n + 1 is  the  RHS  (fixed  at  -1.0); 

(c)  the  last  m variables  are  the  logicals  (slacks). 

3.  A set  of  (N-l)/80  + 1 cards  indicating  the  state  of  each  of 
the  above  N variables.  One  character  HS(j)  is  recorded  for 
each  J = 1,  2,  ...,  N as  follows,  written  with  F0RMAT(80Il) : 

60 


1 


I 

1 

I 


i-Lli  yirinbl-j 


i.  ■(.! ) 


. It  a to  111 


0 Monba  : tc  at.  lower  botuvi 

1 Nonba.:  ; ■ at  upper  boun'l 

i'  .luperbasie 

3 Pas  ic 

1!'  variable  .1  is  FIXED  (lower  . ound  upper  bound),  then 
|S(,)  nay  be  ( or  1.  Hm  same  is  t rue  if  variable  j Is 
' Inn nite  bounds)  and  still  nonhasle,  al though  free 


variables  will  usually  be  baric. 
\ . -t  of  cards  of  the  form 


where  j is  a variable  number  and  x . is  a value.  These 

J 

are  written  with  F0RMAT(l8,  lPE2t.l4)  and  are  terminated  by 
a card  with  .j  0.  Normally  j will  be  in  the  range  1 to 
N arid  will  correspond  to  a variable  for  which  HS(,j)  - 2 
(auperbas  Lc) . 

Notes  on  Input  of  an Oljv  iftvlS 

1.  bard  1 above  is  printed  but  not  otherwise  used. 

2.  The  values  labelled  M and  N on  card  2 must  agree  with  those 
for  the  MP3  file  that  has  just  been  read.  The  value  labelled 
SB  is  read  and  printed  as  an  integer  but  is  not  otherwise  used. 
Cards  3>  4,  etc.,  mast  contain  exactly  M values  HS(j)  = 3 
(for  the  basic  variables). 


Ml 


3. 


4.  The  cards  containing  j and  x.  values  need  not,  occur  in 
natural  column  order  (e.g.,  see  Figure  1).  The  user  may 
modify  or  extend  this  list  of  cards  relatively  easily  as  long 
as  the  following  points  are  borne  in  mind. 

5.  The  list  should  include  a card  for  all  variables  whose  state  is 
HS(j)  = 2 (superbasic) . 

6.  For  any  given  ,j  and  x.,  if  HS(j)  f 3 then  variable  j will 

normally  be  initialized  at  the  value  x.  and  its  state  will  be 

J 

reset  to  HS(j)  = 2 (superbasic). 

7.  If  H5(j)  = 3,  the  value  x . will  be  recorded  for  nonlinear 
variables  but  no  other  action  will  be  taken  (thus  variable  j 
will  remain  basic). 

8.  If  the  specified  value  x.  lies  on  or  outside  the  bounds  on 
variable  j,  or  if  the  total  number  of  super-basics  has  already 
reached  the  limit  specified  in  the  SPECS  file,  then  variable 


j will  be  made  nonbasic  at  the  bound 


to  x 


V.2.  PUNCH  and  INSERT  files  f industry  standard) 

These  files  specify  a basis  by  a list  of  cards  of  the  form 


INDICATOR  MAME1  NAME2  VALUE 


as  shown  in  Figure  2.  The  output  to  a PUNCH  file  may  be  used 
directly  as  input  from  an  INSERT  file,  either  for  MINOS  or 
(if  the  problem  is  purely  linear)  for  one  of  the  commercial  LP 
systems.  The  various  indicators  are  best  defined  in  terms  of  the 
action  token  on  input.  It  Ls  assumed  that  the  basis  is  initially 
the  set  of  logical  variables  and  that  the  structurals  are  nonbasic 


at  their  smallest  bound  in  absolute  magnitude. 


hhme 

WLHpnn  h 

MJUCH.  II-ISEK  1 

::l 

XL  IS 

L 1 

5.  US  1550+11  1 

sB 

XU  21 

1 . 351 650+0 1 

SB 

1 . 36U 4 60+ 00 

' H 

: :n  25 

4. 540  8 2D +i.i  1 

SB 

; :u  35 

4 . 862090+11 1 

SB 

: :uH2 

2.348950+0  1 

SB 

;:u52 

2. 0 89960+0  1 

XL 

XU  1 

L2 

1 . 0 0 Li  ij  0 I J+u  J-‘ 

XL 

:;uxi 

L3 

3.91  0 0 0 0+0  I 

SB 

XU  si 

2. 70663  0 + 0 1 

SB 

Xi  9 1 

2.031 660+0 1 

XL 

;■ ; i o 5 

L4 

5.11  >230+0 1 

XL 

XI  14 

L5 

3.31  9740+1..  1 

SB 

• : i .4 

4.093430+0  1 

SB 

X 1 35 

5.401 52D+U 1 

XU 

X 1 4 4 

67 

5. 682360+0 1 

XL 

X 1 52 

SB 

2.62 1 1 20+0 1 

XL 

X 1 53 

69 

4. 378860+u  1 

SB 

X 1 62 

2.  423650+11  1 

: :u 

1 64 

1 1 1 0 

1 . 70  4460  + ii  1 

SB 

X 1 72 

3.  602750+0  ij 

SB 

XI  73 

7. 20 3360+ 0 1 

SB 

XI  S3 

5.755150+0 1 

SB 

X 1 93 

6.42 1 1 50+0 1 

XL 

X20  3 

61  1 

6.241  4 >0+i i 1 

SB 

SB 

-1.11 3230+0  1 

>B 

by 

-6.623750+00 

SB 

iii  i 

-6. 281 090+00 

ENDATfi 

It  II 

1 5 1215 


Figure  2.  Format  of  i-'UHiH  arid  IWBERT  FILL- 
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lM!  Ia'A  i'O!: 


Action  Tak-n  Puri  ’u'  INFEPl' 


XL  (XU)  Make  structural  NAMK1  basic  and  logicrl  f JAMJtl 

nonban ic  at  its  lower  (upper)  bound. 

LI,  (UL)  Make  variable  MAME1  nonbasic  at  its  lower  (upper) 

bound . 

SB  Make  variable  NAMF1  superbasic  at  the  value  VALUE. 

botes  on  PUNCH  Data 

1.  Variables  are  output  in  natural  order.  For  example,  on  the 
first  XL  or  XU  card,  NAME1  will  be  the  first  basic  structural 
and  NAMES  will  be  the  first  logical  which  is  not  basic  (it  may 
be  nonbasic  or  superbasic). 

2.  Indicator  SB  is  an  addition  to  the  standard  format  to  allow 
for  non-vertex  solutions. 

3.  Superbasic  logic a Is  are  output  last.  These  will  be  some  of  the 
logicals  which  previously  appeared  as  NAMES  (e.g.,  logicals 
08,  09,  Gil  in  Figure  2) . 

b.  PUNCH  and  INSERT  files  deal  with  the  status  arid  value  of 

logical  variables,  whereas  SOLUTION  files  deal  with  row  status 
and  activities. 

5.  LL  or  UL  cards  are  not  output  for  nonbasic  variables  if  the 
corresponding  bound  value  is  zero. 


a 


I 


Notes  on  INS Ell ' :U-LH 

1.  Preferably  an  INSERT  file  should  be  an  'mmod Lfied  PUNCH 
file  obtained  from  an  earlier  run  on  the  name  problem. 

2.  VALUE  is  used  only  if  INDICATOR  in  SB  or  NAME1  is  a 
nonlinear  variable. 

3.  Warning  — if  D or  E format  is  used  for  a VALUE,  the 
exponent  must  be  right- justified  to  column  30. 

It.  Additional  SB  cards  may  be  added  before  the  ENDATA  card, 
to  specify  additional  superbasic  structurals  or  logicals. 

(Any  such  card  will  be  ignored  if  previous  cards  have  implied 
that  NAME1  is  basic  or  superbasic,  or  that  NAME2  is  not  basic.) 
5.  If  the  specified  VALUE  on  an  SB  card  lies  on  or  outside  the 
bounds  on  variable  NAME1,  or  if  the  total  number  of  superbasics 
has  already  reached  the  limit  specified  in  the  SPECS  files, 
then  variable  NAME1  will  be  mode  nonbasic  at  the  bound  nearest 
to  VALUE. 

V.  3.  DUMP  and  IDA''  Filer 

These  files  are  similar  to  PUNCH  ani  INSERT  files  but 
record  solution  information  in  a manner  that  is  more  direct  and 
more  easily  modified.  In  particular,  no  distinction  is  made  between 
row  and  column  variables.  (Note  that  status  indicators  and  values 


Each  dutn  card  is  of  t.he  form 

INDICATOR  NAME  (blank)  VAIJJE 

as  shown  in  Figure  3*  The  indicators  LL,  UL,  B5  and  SB  mean 

Lower  Limit,  Upper  Limit,  Basic  and  Superba.cic  respectively. 

Mot'Vj  -u  LUMP  Lata 

1.  Variables  are  output  in  natural  order,  columns  first,  then  rows. 

p.  LL  or  UL  cards  are  not  output  for  nonbasic  variables  if  the 
corresponding  bound  value  is  zero,  or  if  the  variable  NAME  is 
FIXED  (lower  bound  = upper  bound) . 

3.  Nonbasic  FREE  variables  will  be  output  with  either  LL  or 
UL  indicators  but  with  value  zero. 

Notes  on  IPAD  Data 

1.  Normally  a DUMP  file  will  be  valid  as  a LOAD  file  to 
restart  solution  of  the  same  problem. 

VALUE  Is  used  only  if  INDICATOR  is  SB  or  if  NAME  is  a 
nonlinear  variable. 

3.  If  the  VALUE  on  an  SB  card  lies  on  or  outside  the  bounds 
on  variable  NAME,  or  if  the  total  number  of  superbasics  has 
ali’eady  reached  the  limit  specified  in  the  SPECS  file,  then 
variable  NAME  will  be  made  nonbasic  at  the  bound  nearest  to 
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VALUE. 


b.  (partial  basis)  if  fewer  than  M variables  are  specified  to 

i 

t>e  basic,  a tentative  basis  list  will  be  constructed  by  adding 
the  requisite  number  of  logicals,  starlit^'  from  the  first  row 
and  ta/ing  those  that  were  not  previously  specified  to  be  basic 
or  superbasic. 

Note:  If  the  resulting  basis  is  singulab,  the  basis  factoriza- 

I 

tion  routine  will  reject  a number  of  variables  and  introduce 
an  appropriate  set  of  logicals.  The  rejected  variables  will  be 
favored  during  subsequent  iterations  for  readmission  to  the 
basis,  but  otherwise  the  starting  point  obtained  will  not  neces- 
sarily be  "good. " 

5-  (Too  many  basics)  If  M variables  have  already  been  specified 

as  basic,  any  further  BS  indicators  will  be  treated  as  though 

they  were  SB.  This  feature  may  be  useful  in  combining  solutions 
to  smaller  subproblems. 

V.b.  SOLUTION  i'ile 

Figure  U illustrates  the  format  of  the  file  output  at  the 

end  of  a non  if  requested  by  a SPECS  card  of  the  form 

I 

SOLUTION  FILE  k 

(k  > 0). 
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Tin  format  of  a ur in ted  solution  is  essentially  identical 

except  for  the  following: 

1.  'Hie  first  character  in  each  line  is  for  carriage  control  and 
will  not  appear  on  the  printed  pare.  Only  two  lines  have  a 
non-blank  carriage  control. 

2.  Format  Fl6.5  is  used  for  numerical  values  rather  than  1PE16.6. 

3.  Any  UPPER  or  LOWER  LIMITS  that  are  "infinite"  (+  1.0E+30) 
appear  as  the  word  NONE. 


In  the  ROWS  section.  Loth  ROW  and  SLACK  activities 
are  shown.  The  quantities  labelled  DUAL  ACTIVITY  are  the 
simplex  multipliers,  n. 

In  the  COLUMNS  -action,  OBJ  GRADIENT  means,  for  linear 


r 


n 

(i 

o 

n 

n 

o 


If  the  solution  is  infeasible,  the  status  of  basic  and 
superhasie  variables  ( rov/s  or  columns)  may  be  shown  as  follows: 

++  variable  is  above  its  upper  limit 

variable  is  below  its  lower  limit. 

A SOLUTION  file  is  intended  to  be  read  from  disk  by  a self- 
contained  program  which  extracts  and  saves  certain  values  as  required, 
possibly  for  further  computation.  Typically  the  first  14  lines  would 
be  skipped.  Each  subsequent  line  should  be  read  using  a format  of 
the  fonn 

FORMAT (18,  2X,  2A4,  A4,  5E16.6,  16) 

The  end  of  the  ROWS  section  can  be  detected  by  the  almost  blank 
line.  if  this  and  the  next  4 lines  are  skipped,  the  COLUMNS  section 
can  then  be  read  under  the  same  format.  Hence  the  inefficiency  of 
BACKSPACE  or  re-read  operations  can  be  avoided. 
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V I . Hi  start  ! rig  M 'd  i 1'  i ■ 1 i Pro!  dome 


The  preceding  sections  document  three  distinct  starting 
methods  (OU1  BIT  MAP,  INSERT,  LOAD)  which  may  lie  preferable  to 
any  of  the  three  cold  start-  (CRASH)  options.  The  best  choice 
Repeals  on  the  extent  to  which  the  present  problem  has  been  modi- 
fied, and  whether  vs’  \ables  ore  to  be  specified  by  name  or  by  number. 

1.  (Protection)  In  general  the  user  is  protected  against  acci- 
dental specification  of  infinite  bounds.  For  example,  if  UL 
is  specified  for  some  variable  that  has  an  upper  bound  of 
plus  infinity,  the  indicator  is  treated  as  if  it  were  LL. 
Similarly  for  LL  cards,  if  the  variable's  lower  bound  is 
minus  infinity.  No  message  is  issued.  (Note  — switching 
bounds  is  safe  even  with  nonbasic  FREE  variables.  They 
will  be  treated  as  having  value  zero.) 

2.  (Default  status)  If  the  status  of  a variable  is  not  explicitly 
specified,  it  will  initially  be  nonbasic  at  the  bound  which  is 
smallest  in  absolute  magnitude. 

3.  (Relaxing  of  bounds)  Suppose  that  in  Problem  A a certain 
variable  X has  bounds 


0 < X < 5-0 

and  that  when  a solution  is  saved,  X is  nonbasic  at  its 
upper  bound  5*0.  Certain  care  must  be  taken  if  the  user  wishes 
to  iise  the  solution  to  start  some  Problem  H in  which  the  upper 

lb 


I 


1 


1 


b mnd  on  X has  been  relaxed.  If  no  action  is  taken,  two  cases 
arise; 

(a)  If  the  upper  bound  has  been  remove  j . a bound  switch  would 
normally  occur  (e.g.,  UI.  would  be  treated  as  LI,)  and  X 
would  be  made  nonbaaic  *t  Lts  lower  >ourxi,  o.o. 

(b)  If  the  bound  has  been  relaxed  to  some  larger  but  finite 

value,  o..r. , 0 < X ^ 10.0,  X woul  . ■ • y be  made  non- 

basic  at  that  jpper  bound. 

In  both  cases  the  new  solution  will  clearly  -e  different  from 
the  old.  In  some  situations  this  may  not  be  >f  e in sequence, 
but  often  the  now  solution  may  prove  to  1"  severely  infeasible 
or  seriously  removed  from  optimality. 

The  same  comments  apply  if  X were  FIXED  at  5.0  in 
Problem  A. 

To  retain  the  original  solution  precis  ly  (all  other  things 
being  equal),  the  user  need  only  request  that  X be  made  super- 
basic  at  tii"  required  value  5.0.  TV  means  Inserting  a card 
of  the  form 


j 5-0 


near  the  end  of  a bit  map,  or  an 


SB  X 5.0 


card  near  the  end  of  an  INSERT  or  LOAD  file. 
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In  all  cases,  the  necessary  storage  must  be  requested  by  a 


SPECS 


card  of  the  form 


SUPERBASICS  k 


where  k is  at  least  as  large  as  the  number  of  superbasics 
being  specified. 

In  case  (a)  above  the  user  may  happen  to  know  that  the  upper 
bound  5.0  in  Problem  A will  effectively  be  a lower  bound  on 
the  optimal  value  of  X in  Problem  B.  Of  course  it  would  then 
be  simple  to  define  the  bounds  on  X to  be 

5.0  < X < » 

in  the  MPS  data  for  Problem  B,  and  no  further  action  need  be 
taken.  In  case  (b),  the  bounds 

5.0  < X < 10.0 

could  be  included,  and  the  state  of  X would  have  to  be  changed 
from  UL  to  LL.  However,  when  many  interacting  variables  are 
involved  it  may  be  difficult  to  determine  in  advance  that  X 
will  move  above  its  old  bound;  the  previous  method  (making  X 
superbasic)  is  then  much  to  be  preferred. 


% 


(Tightening  of  bounds)  If  Problems  A and  B have  the  bounds 


0 < X < 5.0 


0 < X < 2.0 


respectively,  and  if  X is  again  at  its  upper  limit  in 
Problem  A,  there  is  no  way  in  general  of  initializing  X 
at  value  5-0  for  Problem  B.  MINOS  will  move  X to  its 
nearest  bound,  in  this  case  2.0,  and  hopefully  most  users 
will  be  happy.  However,  note  the  following  rule  of  thumb. 
(Other  modifications)  Wherever  possible,  a series  of  problems 
should  be  ordered  so  that  the  most  tightly  constrained  cases 
are  solved  first.  Their  solutions  will  often  provide  feasible 
starting  points  for  subsequent  relaxed  problems. 


VII.  The  n e rat  ion  Log 

One  line  of  information  is  printed  on  file  6 every  k-th 
iteration,  where  k is  specified  by  a card  of  the  form  IOC 
FREQUENCY  k.  The  default  value  is  k 1.  For  large  problems, 
k = 10  will  save  a significant  volume  of  paper. 

In  the  following  description,  a PRICE  operation  is  defined 
to  be  the  process  by  which  one  or  more  nonbasic  variables  are 
selected  to  become  sunerbas ic . Normally  just  one  variable  is 
selected,  which  we  will  denote  by  J.  If  the  problem  is  purely 
linear,  variable  J will  usually  become  basic  immediately  (tinless 
it  should  happen  to  reach  its  opposite  bound  and  return  to  the 
nonbasic  set). 

If  Partial  Pricing  is  in  effect,  variable  J is  selected 
from  the  matrix  f^pp  where  App  is  the  PP-th  partition 
of  A,  and  I corresponds  to  the  slack  variables. 

If  Multiple  Pricing  is  in  effect,  several  variables  may  be 
selected  from  the  whole  matrix  [A  I].  In  this  case  J refers 
to  the  variable  with  the  largest  favorable  "reduced  cost." 

The  iteration  log  includes  the  following  items. 
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The  current  iteration  number. 


The  current  phase,  as  follows: 

1 =>  Phase  1 simplex  procedure  (the  current  solution 

is  infeasible). 

2 =>  Phase  2 simplex  procedure  (e.g.,  if  the  problem 

is  a linear  program,  or  if  none  of  the  nonlinear 
variables  is  basic) . 

5 =>  A PRICE  operation  has  just  been  performed  and 
the  current  iteration  is  a non-simplex  step. 

U =>  Optimization  is  being  performed  amongst  the 

current  basic  and  superbasic  variables  (ignoring 
the  nonbasics) . 

The  "Partial  Price"  indicator,  reset  by  the  PRICE 
operation  in  Phase  1,  2,  or  3. 

PP  = 1 if  partial  pricing  is  not  in  effect. 

PP  = 0 if  variable  J is  one  of  those  rejected  from 
the  basis  by  the  previous  basis  factorization. 
Tiie  number  of  "non-optimal"  variables  present  in  what- 
ever set  of  nonbasics  was  scanned  during  the  last  PRICE 
operation.  Reset  in  Phase  1,  2,  or  J. 

In  Phase  1,  2,  or  3 this  is  "DJ,"  the  reduced  cost  of 
the  variable  J selected  by  PRICE.  In  Phase  U it  is 
"RG, " the  norm  of  the  reduced  gradient  vector}  i.e.,  the 
larrest  reduced  gradient  amongst  the  current  set  of 
superbasics. 
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+SBS 


The  variable  J selected  by  PRICE  to  become  superbasic. 
The  variable  chosen  to  leave  the  set  of  superbasics 
(to  become  either  basic  or  nonbasic). 


* 


-SBS 

-BS 

STEP 

PIVOT 

NSPK 


L 

U 


NI.NF 


The  variable  chosen  to  leave  the  basis  to  become  nonbasic. 
The  distance  moved  along  the  current  search  direction. 

If  column  a^  replaces  the  p-th  column  of  the  basis 
B,  this  is  the  p-th  element  of  the  transformed  column 
B_1a  . 


q 

The  current  number  of  spikes  in  the  LU  factorization 
of  B.  This  is  the  number  of  non-trivial  columns  in  U 
(excluding  ones  that  have  been  deleted  in  earlier  itera- 
tions) . 

The  number  of  nonzeros  in  the  L part  of  the  factoriza- 
tion of  B (excluding  elements  that  are  imbedded  in 
the  constraint  matrix  A). 

The  number  of  nonzeros  in  the  U part  of  the  factoriza- 
tion of  B (including  ones  in  spikes  that  have  been 
deleted  in  earlier  iterations).  This  does  not  include 
nonzeros  in  a certain  matrix  F,  which  is  really  part 
of  U but  is  stored  separately  as  an  upper  triangular 
matrix  of  dimension  NSPK. 

The  number  of  infeasibilities  before  the  present  itera- 
tion. (Note  — this  number  need  not  decrease  monotonically. 


) 
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I 
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SINF/  If  NINF  > 0,  this  is  SINF,  the  sum  of  infeasibilities 

OBJECTIVE 

before  the  present  iteration;  it  should  decrease  mono- 
tonic ally. 

If  NINF  = 0,  the  value  of  the  true  objective  after  the 
present  iteration  is  given  (including  both  linear  and 
nonlinear  terms) . 

The  following  items  are  printed  if  the  problem  is  nonlinear 
or  if  the  Fhase  is  3 or  4. 

NFG  The  number  of  times  the  nonlinear  objective  and  its 

gradient  have  been  evaluated. 

NSB  The  current  number  of  superbasic  variables. 

RIM  An  indication  of  the  type  of  modifications  that  have 

been  made  to  the  matrix  R being  used  to  approximate 
the  projected  Hessian  matrix. 

H-CONDN  This  is  an  estimate  of  the  condition  number  of  the 

reduced  Hessian  matrix.  More  precisely  it  is  K, 

the  square  of  the  ratio  of  the  largest  and  smallest 

diagonals  of  the  triangular  matrix  R,  which  constitutes 

a lower  bound  on  the  condition  number  of  the  matrix 
T 

(R  R)  that  approximates  the  projected  Hessian. 

The  value  of  K gives  a rough  indication  of  whether 

or  not  the  optimization  procedure  is  having  difficulty. 

Let  € be  the  relative  precision  of  the  floating-point 

arithmetic  being  used.  The  reduced -grad lent  algorithm 

-1/2 

will  make  slow  progress  if  K becomes  as  large  as  € ' 
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and  will  probably  fail  to  find  a better  solution  if 
K reaches  or  larger.  In  such  cases  the  user 

should 

(1)  check  that  the  constraint  matrix  is  well  scaled} 

(2)  scale  the  variables  involved  in  the  nonlinear 
objective  so  that  the  Hessian  matrix  is  as  well 
conditioned  as  possible  (ignoring  rows  and  columns 
corresponding  to  nonbasic  variables)} 

(3)  add  upper  or  lower  bounds  to  certain  variables  to 
keep  them  a reasonable  distance  from  any  singu- 
larities in  the  objective  or  its  derivatives. 

CONV  A set  of  four  logical  variables  , C,  , Cv,  that 

are  used  to  determine  when  to  discontinue  optimization 
in  the  current  subspace  (Phase  4)  and  consider  moving 
off  a constraint  (Phase  3) • 

Let  RG  be  the  current  norm  of  the  reduced  gradient. 

The  meaning  of  the  C . is  briefly  as  follows : 

C is  TRUE  if  the  change  in  x was  sufficiently  small. 

C,  is  TRUE  if  the  change  in  f(x)  was  sufficiently 

small. 

C_  is  TRUE  if  RG  is  smaller  than  some  loose 

3 

tolerance. 

is  TRUE  if  RG  is  smaller  than  seme  tight 

tolerance. 
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The  test  used  is  of  the  form  if  (C^  and  and  C^) 

or  Cu  then  go  to  Phase  3.  All  tolerances  are  varied 
dynamically. 
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VIII. 


J 

Tolerances  for  Competing  the  Panin  Foe  to  rLz  at  Lon 

Three  tolerances  T , T and  T are  Involved  in  comput- 
r c m 

ing  and  updating  the  L'J  factorization  of  the  basis.  They  may 
be  set  by  specification  cards  of  the  following  form  (their  default 
values  are  shown  as  comments) : 

1 


LU  ROW  TOLERANCE  = 0.01  * DEFAULT  Tr  = 0.001 

LU  COL  TOLERANCE  =0.9  * DEFAULT  Tc  = 0.1 

LU  MOD  TOLERANCE  =1.0  * DEFAULT  T = O.99 

m 

The  use  of  T and  T must  be  understood  in  terms  of  the  "bump 
re 

and  spike"  structure  of  a basis  matrix  as  introduced  by  Hellerman 

and  Rarick  (1971,  1972)  in  their  Preassigned  Pivot  Procedures  P''’ 

1+ 

and  P . The  general  aim  is  to  accept  the  preassigned  pivot  order 
whenever  possible  (since  it  has  close  to  the  minimal  number  of 
spikes)  but  to  revise  this  order  where  necessary  to  maintain  numerical 
stability. 

In  this  context,  attention  is  restricted  to  the  rows  and 
columns  inside  any  one  bump,  and  the  diagonal  elements  between 
bumps  are  regarded  as  bumps  of  dimension  1.  Each  column  in  a bump 
is  initially  either  a spike  column  or  a triangle  (non-spike)column. 

The  k-th  column  in  a bump  fails  a row  test  if  its  preassigned 
pivot  element  is  smaller  than  Tf  times  the  largest  remaining 
potential  pivot  in  that  column.  Some  replacement  column  is  then 
selected  from  the  remaining  spikes  in  the  bump  as  follows.  The 
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pivot  elements  a.  are  computed  for  each  remaining  spike  and  the 

Ifmip.qt..  (7  . if?  determined.  Let  column  s be  the  first  spike 

max 

such  that  ag  is  larger  than  Tc*arnax-  Then  columns  k and  s 
are  interchanged. * 

The  above  process  amounts  to  Gaussian  elimination  with 
column  interchanges. 

Increasing  T towards  1.0  will  tend  to 
r 

(a)  increase  the  amount  of  column  interchanging  (spike-swapping); 

(b)  increase  the  total  no.  of  spikes  (if  column  k above  is  a 
triangle  column  the  spike  count  will  increase  by  1); 

(c)  increase  the  density  of  the  LU  factorization  (fill-in 
occurs  only  in  spike  columns); 

(c)  improve  numerical  stability. 

Increasing  Tc  towards  1.0  will  tend  to 

(a)  increase  (slightly)  the  density  of  the  LU  factors  (early 
spikes  are  generally  shorter  and  will  have  less  fill-in 
than  later  spikes), 

(b)  improve  numerical  stability. 


+If  there  is  no  suitable  substitute,  column  k will  be  replaced 
by  an  appropriate  slack  vector. 
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For  large-scale  problems  the  total  number  of  spikes  is 

critical  and  a compromise  must  be  reached  between  sparsity  and 

stability.  The  default  values  for  T and  T are  safe  for  most 

r c 

■ 

problems.  If  numerical  difficulties  arise,  can  be  increased 
to  0.01  and  to  0.9  or  0.99  without,  serious  loss  of  efficiency. 

Larger  values  for  T may  degrade  performance  significantly. 

For  small  dense  problems  (i.e.,  "non-LP"  problems  such  as 
those  arising  from  data-f itting) , maximum  stability  is  readily 
obtained  by  setting  both  T and  to  O.99  (say).  The  loss  of 

efficiency  will  be  negligible. 

Stability  during  updating  of  the  LU  factorization  is  controlled 

by  the  tolerance  T . In  this  implementation  of  the  method  of  Bartels 
m 

and  Golub,  maximum  stability  is  obtained  via  the  default  value 
T = O.99  with  essentially  no  loss  of  efficiency.  There  is  normally 
no  reason  to  use  a smaller  tolerance.  However,  one  can  simulate 
the  numerical  properties  of  the  mechod  of  Forrest  and  Tomlin  (1972)  by 
setting  T =0.0. 

.1 

1 

I 

3 
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IX.  System  Informal  i on  — Machine-Dependent  Matters 

The  source  code  for  MINOS  is  approximately  8300  cards  of 
standard  Fortran  IV.  One  of  the  design  goals  has  been  to  maintain 
compatibility  with  the  Fortran  compilers  on  the  principal  large 
scientific  machines  (e.g.,  IBM,  CDC,  Univac,  Burroughs).  At  the 
same  time  it  has  been  possible  to  maintain  a reasonably  high  level 
of  efficiency  and  flexibility.  For  example,  problems  of  arbitrary 
size  may  be  solved  without  recompilation  of  the  program,  and  the 
method  for  allocating  storage  can  take  maximum  advantage  of  the 
available  word  sizes  on  a particular  machine. 

The  main  items  involved  in  installing  the  system  on  a machine 
other  than  the  IBM  Systems  ?60  and  370  are: 

— The  setting  of  4 variables  in  subroutine  INITIZ. 

— The  hash  function  used  in  subroutine  HASH. 

— The  file  numbers  used  for  the  reader,  printer  and  scratch  files. 
These  topics  are  documented  in  the  following  sections. 

IX. 1.  Precision.  Word  .Sizes 

Four  scalar  quantities  must  be  initialized  in  subroutine 
INITI2  to  match  any  particular  machine.  Their  values  depend  on 
whether  single  or  double  precision  floating-point  arithmetic  is 
required  throughout,  and  their  meaning  is  best  understood  in  terms 
of  the  following  values  which  are  appropriate  for  the  IBM  System/370: 
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EPS 


= 16.0** (-13) 


NWORDK  = 2 
NWORDI  ■=  2 
NWORDH  = h 

The  variables  in  all  relevant  subroutines  are  implicitly 
typed  as  follows: 

IMPLICIT  REAL(A-B),  KEAL*8(C-G,  0-Z) , INTEGER (I-N) , INTEGER*2 (H) 

Furthermore,  all  array  storege  is  provided  by  segmenting  a single 
array  of  the  form 


REAL*8  Z(NWCORE) 

For  the  IBM  370,  the  four  critical  values  above  are  therefore  inter- 
preted as  follows : 

1.  EPS  contains  the  smallest  positive  number  such  that 

W = 1.0  + EPS 

gives  W a value  greater  than  1.0.  (We  assume  that  the  Fortran 
compiler  will  convert  1.0  to  double  precision  and  perform  the 
addition  in  double  precision.) 
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2.  NWORDR  = 2 means  that  if  some  array  is  of  type  REAL  then 

2 elements  of  that  array  occupy  the  same  storage  as  one  element 
of  the  REAL* 8 array  Z.  Similarly,  for  arrays  of  type 
INTEGER  and  INTEGERS,  the  respective  numbers  are  2 and  L 
elements  per  word  of  Z. 

For  machines  with  suitable  single  precision  and  no  half-word 
integers  (e.g.,  CDC,  Burroughs),  REAL* 8 and  INTEGERS  are  replaced 
by  REAL  and  INTEGER  respectively,  and  the  word-size  indicators 
all  take  the  value  1.  The  value  of  EPS  should  then  correspond  to 
single  precision. 

IX . 2 . Subroutine  HASH 

This  routine  is  used  for  storing  and  searching  a table  of 
row  names  during  input  of  the  f.iPS  file.  Some  machine -dependent 
"hash  function"  is  required  for  converting  any  given  8-character 
name  to  a non-negative  integer. 

Spec i f ication 

SUBROUTINE  HASH ( LEN , NEN , NCOLL , 

1 KEY1,KEY2, MODE, K ETTA B, NAME 1,NAME2,KA, FOUND  ) 

INTEGER  KEYTAB(LEN) ,NAME1(NEN) ,NAME2 (NEN) 

LOGICAL  FOUND 

Maitea 

See  Brent  (1973)* 

89 


Remarks 

1.  The  first  application  of  the  required  hash  function  is  to 


the  integer  parameters  KEY1  and  KEY2.  These  variables 
contain  the  left  and  right  halves  of  an  8-character  row  name, 
read  under  2Ak  format.  Thus  each  integer  contains  L charac- 
ters left-justified.  If  the  resulting  bit  pattern  fur  each  is 
a valid  integer  (as  is  the  case  on  the  IBM  560  and  570)  then 
the  statement 

KEY  = IABS( TABS (KEY 1)  - 1AB5(KEY2) ) 

defines  a transformation  which  will  produce  a suitable  non- 
negative integer  KEY  from  the  quantities  KEY1  and  KEY2. 
(Note  that  subtraction  of  non-negative  integers  cannot  cause 
overflow. ) 

2.  On  some  machines  (e.g.,  the  Burroughs  B6700) , reading  the 

integer  variable  KEY1  (say)  under  Ah  format  will  set  bits 
which  are  reserved  for  the  exponent  in  REAL  variables.  In 
such  cases  the  word-length  will  be  greater  than  L characters, 
and  the  simplest  solution  is  to  perform  a right-shift  of  N 
bits,  where  N is  chosen  to  clear  the  exponent  field,  e.g., 

K1  = IR5HFT(  KEY1,N  ) 

K2  = IRSHFT ( KEY2,N  ) 

KEY  = IABS(K1-K2) 
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3.  Note  that  KEY1  and  KEY2  are  later  stored  without  transforma- 
tion in  the  Integer  arrays  NAME1  and  NAMES.  It  must  be 
possible  to  perform  a test  for  equality  of  the  form 

IF  (KEYl.EQ.NAMEl(KT)  .AND.  KEY2 . EQ. NAME2 (KT) ) GO  TO  60 
even  if  the  bit  pattern  of  any  of  the  variables  involved  is 
not  strictly  that  of  an  integer.  (On  the  Burroughs  Bo 700  it  is 
safer  to  replace  .EQ.  by  .IS.) 

1*.  The  same  hash  function  must  be  used  later  within  subroutine 

HASH  to  produce  a non-negative  integer  KEY  from  the  integer 
I *'  variables  NAMEl(KT)  and  NAME2 (KT) . 


IX. 3-  Files  5.  6 and  8 

The  following  file  numbers  are  to  some  extent  built  in  to 
the  system: 


n 


n 


1.  File  5 — the  card  reader. 

(a)  The  SPECS  file  is  normally  assumed  to  be  file  5-  It 
may  be  altered  by  changing  the  variable  ISPECS  in 
subroutine  GO. 

(b)  The  MPS  file  default  value  is  5.  It  may  be  altered  at 
run  time  by  a SPECS  card  of  the  form 

INPUT  FILE  k 


2.  File  6 --  tile  printer. 

All  printed  output  is  written  on  file  6.  This  includes  list- 
ings of  the  : SPECS  and  MPS  'lata,  parameters,  iteration  log, 
solution,  error  messages,  etc.  If  necessary,  the  characters 
"WRITE(6"  may  be  altered  in  all  relevant  subroutines. 

3*  File  8 — the  scratch  file. 

(a)  This  file  is  used  during  input  of  the  SPECS  file.  It 
facilitates  interpreting  of  free-format  data  in  a way 
that  is  machine-independent. 

(b)  The  scratch  file  is  later  used  to  store  ROW  and  COLUMN 
names  from  the  MPS  data. 

(c)  For  both  purposes  the  recording  format  should  be  fixed 
and  blocked,  with  a logical  record  length  of  8 characters 
(n.b.  not  80) . The  block-size  should  be  at  least  800 

or  1600  characters  for  efficiency. 

(d)  The  file  number  may  be  altered  by  changing  the  variable 
ISCRCH  in  subroutine  GO.  It  must  be  different  from  the 
value  in  variable  ISPECS. 

Note  that  certain  files  are  subject  to  a Fortran  REWIND, 
except  if  their  file  numbers  are  5 or  6 as  the  case  may  be. 

IX. t.  Using  MINOS  as  a subroutine 

As  currently  Implemented,  MINOS  is  intended  for  use  primarily 
ns  a "stand-alone"  system,  which  simply  solves  a sequence  of  problems 
and  then  terminates.  Figure  5 illustrates  the  subroutine  hierarchy. 
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In  particular, 


1.  The  MAIN  program  provides  a single  array  of  storage  to  the 
system,  thus: 


RSAI,*8  Z (20000) 

DATA  NWC0RE/20000/ 


CALL  GO ( Z,NWCORE  ) 


RETURN 


For  solution  of  larger  problems,  storage  can  be  easily  increased 
by  changing  the  first  two  cards.  Alternatively  an  assembly 
language  MAIN  program  may  be  used  to  acquire  storage  at  run- 
time. (For  example,  the  I EM  370  version  of  MINOS  uses  an 
assembly  routine  to  access  all  available  core  via  a GETMAIN 
operation,  returns  LOK  bytes  for  buffer  storage,  and  then  calls 
subroutine  GO  as  above.) 

2.  Subroutine  GO  is  a control  routine  at  the  root  of  the  sub- 
routine tree  structure.  It  may  be  expanded  for  specific  appli- 
cations. As  given,  its  main  purpose  is  to  call  subroutine 
MINOS  and  to  determine  when  all  of  a possible  sequence  of  problems 
has  been  processed. 


9** 


3.  Subroutine  MINOS  and  its  sub-programs  communicate  with  the 
outside  world  by  means  of  certain  files,  including  the  SPECS, 
MPS,  BASIS  and  SO  LIT!' ION  files.  Subroutine  MINOS  also  has 
output  parameters  which  define: 

(a)  the  stopping  condition) 

(b)  the  dimensions  of  the  problem  that  has  just  been  processed) 

(c)  the  positions  within  array  Z (above)  where  certain  sub- 

arrays  are  stored.  The  latter  contain  the  final  values 

for  the  solution  vector  x,  the  dual  variables  it,  and 

the  state  vector  defining  whether  each  variable  x.  is 

J 

basic,  supr  or  nonbasi.c  at  upper  or  lower  bound. 

The  subroutine  structure  is  sufficiently  modular  to  allow 
use  of  MINOS  in  several  alternative  environments.  The  principal 
routine  to  be  modified  for  a particular  application  is  subroutine 
GO.  It  is  envisaged  that  in  all  cases,  run-time  parameters  and  the 
constraint  information  will  be  input  via  the  SPECS  and  MPS  files 
(rather  than  by  construction  in-core). 

As  an  example,  the  dotted  lines  in  Figure  5 indicate  how 
Matrix  Generator  and  Report  Writer  modules  could  be  incorporated. 

The  sequence  of  actions 

(a)  Generate  SPECS  file  and  MPS  file 

(b)  Solve 

(c)  Write  report 

could  be  repeated  1 or  more  times. 
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Alternatively  it  may  be  convenient  to  run  the  Matrix 
Generator  as  a separate  program.  This  could  generate  a series 
of  problem  specifications  on  one  SPEC.',  file  (since  the  SPECS 
file  is  not  rewound  after  processing  of  the  END  card).  The 
corresponding  MPS  data  could  be  generated  as  one  MPG  file 
(with  multiple  RHS,  RANGE  or  BOUND  sets),  or  as  several 
separate  files. 

The  Report  Writer  may  access  solutions  either  externally 
(through  the  SOLUTION  file)  or  in-core  (through  the  parameter 
list  of  subroutine  MINOS  as  noted  above) . In  some  cases  the 
SCRATCH  file  may  be  useful  to  provide  the  ROW  and  COLUMN 
names  as  a sequence  of  8-byte  records. 

A slightly  different  situation  arises  if  MINOS  is  to  be 
used  iterativeTy  for  solving  a sequence  of  linearly  constrained 
problems  in  which  the  solution  to  one  problem  defines  the  constraints 
for  the  next.  This  is  a possible  approach  to  solving  problems  with 
nonlinear  constraints.  In  such  cases  it  is  likely  that  a large 
portion  of  the  constraint  matrix  will  in  fact  be  constant.  The 
Matrix  Generator  could  set  this  up  as  a permanent  file,  while 
generating  the  MPS  and  SPECS  files  required  for  the  first  Solve 
step.  After  each  Solve,  the  "Report  Writer"  could  then 

(a)  Access  the  solution  as  described  above,  test  for  convergence 
and  stop  if  necessary. 

(b)  Generate  new  matrix  coefficients  and  merge  with  the  permanent 
file  to  produce  a new  MPS  file. 
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(o)  Generate  an  appropriately  modified  SPECS  file. 

(d)  Modify  relevant  parameters  used  in  the  objective  function. 

(e)  Return  to  the  Solve  step. 

Although  purely  in-core  operation  is  generally  preferable,  most 
of  the  computation  for  large  problems  will  occur  in  the  Solve  step. 
The  interspersed  file-handling  should  therefore  incur  relatively 
negligible  cost. 
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This  section  illustrates  the  Job  Control  required  to  compile, 
run  and  modify  MINOS  on  an  IBM  System  jGO  or  Y(0  operating  under 
OS.  Some  of  the  parameters  >ised  may  be  peculiar  to  0S/VS2  and/or 
the  particular  installation  at  the  Stanford  Linear  Accelerator  Center. 
Various  DSNAMKS  and  VOLUME  names  may  also  need  to  be  altered. 
However,  the  main  requirements  should  be  apparent. 


X . 1 . To  Compile  MINOS  and  .save  the  Resulting  Load  Module 

In  this  example  an  executable  prqgram  called  NLP PGM  is 
created  as  a member  of  the  Partitioned  Data  Set  called  WYL.W8.MXS. TOAD, 
which  will  reside  on  a 2J1U  disk  unit  called  WYLOOA. 

The  compile  time  for  8000  Fortran  source  cards  using  the 
I EM  Fortran  (H  Extended)  compiler  with  full  optimization  is  approxi- 
mately to  seconds  on  an  IEM  370/168. 


/v  JiJB  , T I ME*  < I , 0 0 ) , RF b [ hi  ) ~ 

v EXEC  FORTMCL  »FAftM.  FORT*  ’OPT * ? , fi  iHAP , MOSOUPCE " , 
//  F 0 R T P P T = D I J M M V . 

/ / FORT  TIM*  * < 1 ,00  1 » ,F0RTtif  p=hi  |.| 

F OPT . SYS  I M DD  *■ 


Fortran  source 


’# 

vLhtD . SVSLMOD  UD  0SH*NVI  . hi-.: . MM:  . u.'HLi , Ul  1 1 T = ■ ' i Si  . 
'/  D I SP*  < MF  I'J , Cfl  T Lb  ) . «UL  ' .FKsWVLO  0 H , 

/ DCB* k PECFM=U  jLPF.Cl  " ,BLJ  s IZE-JiSJ'i:  . , 

v SPACE* < T RK  , ( 40  . , I ■ . • LSE  > 

/LKED.SVSIM  OD  + 

EMTRV  MAIN 
NAME  NLPPGM 

* 
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To  ?Ajn  MI  NO.1  ■ 
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LTie  following  job  Is  suitable  for  running  the  load  module 
created  by  the  preceding  example,  or  by  the  example  in  Section  X.t. 


below.  Note  that  the  DDNAMES  of  the  form  ' FTnnFOOl ' do  not  have 
the  usual  'GO.'  attached,  because  the  EXEC  card  specifies  NLPPGM 
directly  rather  than  through  a Cataloged  Procedure. 

- The  3rd  and  Uth  characters  in  each  'FTnnFOOl'  DDNAME  refer 
to  file  numbers  which  are  used  in  Fortran  I/O  statements  such  as 


READ(nn,  f ) . 


FT05F001 

FT06F001 

FTOSFOOl 


FT09F001 


Refers  to  the  card  reader. 

Refers  to  the  printer. 

Defines  the  scratch  file.  Note  that  the  logical 
record  length  is  LRECL-8,  not  IRJ£CL=80. 
etc.  refer  to  various  basis  and  data  files  as  required 
for  a particular  run.  Note  that  DISP=SHR  implies 
that  a file  already  exists  (as  does  DISP=OLD) . 

If  necessary  some  dummy  file  should  be  set  up  before 
the  run.  Otherwise,  DISP=SHR  must  be  replaced 
by  DISP=( NEW, KEEP)  and  appropriate  DCB  and 
SPACE  parameters  must  be  defined. 
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/ JOB  .1  IMt  = OJ  , 1 *:<  ,i?ESIOH=jfJ:Oi  «l,r-*GLtULL r • n ,0  ) 
/MIH03  EXEC  F'GH=NI>'PhM 


DCB=  RECFM=FRfl  ,LF’EC  L=  1 :3  , BLf  S f E*3458  , BUF HO=.  • 


. :-,TEPL  IB 

DO 

DSN=MVL 

✓FT06F00 1 

DO 

3VSQUT® 

/ 

DCB= 

PECFM= 

• FT OS F 00  1 

DO 

UN I T =SV 

DCB= 

CPECFt1= 

.'FT09F00  1 

OD 

UNITED I 

0 1 3P 

=3  HP 

•FT  1 0F00  1 

00 

IJH  i T-D 1 

□ ISP 

*3  HR 

■FT  1 1 F 0 0 1 

00 

UN I T=D  r 

/ 

DI3P 

=SHR 

/F T05F00 1 

OD 

* 

S I ZE - 1 60 0 > 

no  1 .esn-WVL. WW.Mi 


6. 6H-.  I1:.  I , 
■ . BH3  I 3Z  • 

Hh"-.[IRTH 


SPEC 


MRS  data,  if  INPUT  FILE  11  U not  used  OTIICOOI  «5uve> 
Hr, q data  required  ns  subroutine  CHLlT 6 


♦ 


X. 3-  To  Compile  CALCFG  and  Other  Subroutines  and  Link  to  MINOS 

The  following  job  shows  how  to  link  one  or  more  new  or  altered 
subroutines  to  MINOS  and  run  the  resulting  program.  This  mode  of 
operation  is  normally  used  to  include  a user's  own  nonlinear  objec- 
tive subroutine  (CALCFG)  or  to  test  special  versions  of  some  of 
the  subroutines  in  MINOS. 

In  the  Link  Edit  step,  the  two  XLIB  cards  refer  to  an 
existing  load  module.  The  new  load  module  is  not  saved. 
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' JOB  ,TlMtss<li  « 15.)  jREl3l0i1*32Ul  . HuGLfc 1 'LL-  1 ,i'i  ) 
i LG  ! y.i  i.  I 0RTHCL6  »PARN.  FOPT=  ' tPI  *2  ,NOHAP  , NOSOURCE  * , 
FOPTPPT =DUMMV  , U EDFRT=0UNN7 , 

FOPTTIM*  ’ O't  ,4m  > ■ ,F ORTUER=NEW 
F OPT . SVS 1 4 Ml  i 4 


F o r t r a ri  s ou r c e + t> r . > ► ?ub r ou  • i o k 


4 


SLY  ELI . : :L  1 B UP  DSI l=WVL . . NX: . . LUND  , D l SP~BHP 

SLY  ED. MVS IN  OD  4 
INCLUDE  XL  IB':  NLPPGM > 
b'NTPV  MAIN 

* 


•••' G i J .Flu oF i.i 0 I 
-nO.  F TO  UFO  0 I 
• '-'GO.  t T 1 OF  00  1 
••-'GO.  FT  1 1 r0 0 1 


OD  IJU I T=SVsDH  , 3PACE= 1 T'PK , ■ 4 ,4  > • , 

DCB=<  F ECFH=FR  ,LRECL=8  ,BLKSIL'E=  l 6U0 

OD  UN  I T =r  1 1 Sk  . U 0 L - S E R = S C R 0 0 1 . USM=WVL  . W8 . NXS . BAS  I S 1 , 
DISP=SHR 

OD  UN  I T=D  I 3k  , UOL~SER=SCRO  h 1 . OSN=tJ'-'L . W8 . MXS . BAS  1 S2  , 
DISP-SHR 

HD  IJN  i f -D  l SK  , UOL  -BtR=3CRh 0 1 , u3N=HVI. . W8 . H!  IS . NPSDATA  , 


DISP=SHR 


ss GO . SYS I N DD  4 


SPECS 

MPS  data?  i f I NPU  I F ILE  11  i r ri o t 1 1 s * d 'GU.FT  | 1 *- t.t 0 1 a £i ov t •' 
Ari'-i  data  required  v ‘-i  subroutine  lfiu  Fg 


X.L.  To  Create  and  Pave  a New  Load  Module 

In  this  example  the  UCED.SYSIMOD  card  specifies  where  the 
new  version  of  MINOS  is  to  be  saved.  About  Bo  tracks  of  2J1C  disk 
are  required,  or  about  20  tracks  of  3330  disk. 


101 


j 

If  necessary,  any  object  decks  (e.g.,  from  assembly  language 
versions  of  certain  subroutines)  should  be  included  immediately 
after  the  IKED.SYSIN  card. 


JOB  ,7  I ME=  •'  u , 1 5 » , ,lt  .ibLE'.'fc  L - 1 ' .*•  ‘ 

f L EXEC  FOPTHOL  «PhPM.  FOF'T-  ’OPT"  ' ,NuMAP  ,NlJ$OUPi;  t ’ . 

FORTPPT =DUNMV , 

LkEDF'RT = DUMMY . 

FORTT IM=  » (d  ,40  ) ’ , oF*TU'  F-NEU 
//FORT . SYS 1 0 DO  t 


Fortran  source  for  new  jucrouti nes 


/# 

//LI  tD . oVSLMOD  UD  OSM*MVL . WO . MKS . LOAD  , Oi  l l I =0 1 -t  , 

0 1 SP=  ’ NEW , fcfc'E  P > , iJOL-r.t  P -l-JVL  0 OB  , 

DCB= •:  RECF  M=U  , LRECL® 3520  , BLKS 1 ZE  -3520  > , 

//  SPACE®  <.  T RK  • < 40  » 5 » 1 > . RLSE 

VLl  ED . XL  i Ei  UD  DSN=MVL . WO . HXS . LOAD  , U I SP-sHR 
//LKED.SYS1N  DD  * 

I WCLUDE  XLIEKNLPPGM) 

ENTRY  MAIN 
NAME  NLPP6M 

1 


Note  that: 

— the  old  load  module  library  (WYL.W8.MXS.  LOAD)  is  assumed  to  be 
CATALOGed  on  the  appropriate  volume  (e.g.,  WYLOOA  as  in  the 
first  job)  •, 

— the  new  load  module  library  has  the  same  name  and  must  therefore 

reside  on  a different  volume,  in  this  case  WYLOOBj  j 

I 

1 

I 


102 


— the  name  of  the  new  executable  propram  is  also  the  same  as 
before  (NIP PGM) . 

The  purpose  here  is  to  make  creation  of  the  new  version  of 
MINOS  transpai'ent  to  the  previous  two  .jobs,  which  use  whatever 
version  happens  ^o  be  referred  to  by  ahe  system  CATALOG.  It  should 
now  be  possible  to  type  a command  of  the  form 

RECATALOG  LOAD  ON  WYLOOB 

on  the  local  terminal  system,  and  the  deed  will  be  done. 

If  the  required  terminal  system  facilities  are  not  available, 
the  following  job  illustrates  how  the  RECATALOG  operation  may  be 
accomplished  using  JCL  alone.  The  point  here  is  that  the  new 
load  module  can  be  cataloged  only  if  the  old  version  is  uncataloged 
in  a previous  job  step. 


IOB  ,TIME=<0 


Rpi.rj  I Ufi— ' J b h . Gulp  Ltd.  I.  1 U .0  1 


CL  tXti  F ORTHi'  L « F'HRM . FOPT  = 

FOPTF'RT =DUMMV  - 


'OPT , t lijliOF'  .Oi iSOUl  'CL 


LKEDF'PT =DUMMV  . 
FORT!  I M = * to  ,4U  > 
/ i - OPT . IJliCOT  DO  DSH=U7L . 00 
vFORT.  :VSIH  DD  4 


OPTULrR=HFI'J 

hi:  L-. . L IJHIT , !J  1 Sp~ <:  .HP  ,IJHi  O TT.  h 
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Fortran  source  for  nc.i 


i.j r ou  f.  i nt: 


//LK EL' . SVSLMOD  DD  OUN=WVL . WO . rlXS . LuFlD  , UN  If  *U I Sl\ . 

D I SP-  •:  NEW  , CfiTUa  > , ' 'OL-  SER-WVL bUB  , 

//  DCB=  RECFM=l  I - Lh:ECL=352Cl  . BLH  C I rt=3520  > , 

✓/  SPACE® ' TRK  . 1 40  , 1 , I ) « PLSE  .> 

/,  lKED  . ML  i B DD  UCH-WVL . WU . HXS . L DAD  , U I SF-SHP  , 

UN I T=D I SK , UOL=REF=» . CL . F OPT . UNCflT 
/"/LKED.  CVS  IN  DD  * 

INCLUDE  XLIBCNLPPGM > 

EHTRV  MAIN 
NAME  NLPPGM 

/* 


Beware  that  the  old  load  module  will  be  uncataloged  even  if  the 
compile  or  link  edit  steps  fail. 
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XI.  Further  Examples 

XI.  1.  Kxanple  2 — An  Unc  onstra  I nod  Optimiza  t i on  Problem 

The  following  data  illustrates  minimization  of  the  well 
known  function  (Rosenbrock,  i960) 


f(x)  = 100(x?  - x^f  + (1  - XjT 

without  any  general  linear  constraints. 

Notes 

1.  At  least  one  "constraint"  is  required  in  all  problems.  In 
this  case  the  simplest  technique  is  tc  include  a free  (non- 
binding) row,  called  DUMMYROW  here.  The  basis  matrix  will 
remain  B = 1 throughout,  corresponding  to  the  slack  variable 
on  the  free  row. 

2.  The  COLUMNS  section  contains  just  a list  of  the  variable 
names,  and  the  RHS  section  may  be  null. 

3.  The  bounds  -10  < x.  <10  are  included  via  the  bound  set  BNDX, 

V 

mainly  as  a matter  of  good  practice.  (Their  presence  does  not 
imply  additional  work.)  A uniform  set  of  this  kind  could  also 
be  requested  by  the  SPECS  cards 

LOWER  BOUND  -10.0 

UPPER  BOUND  10.0 
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FUNCTION  AND  GRADIENT  CALCULAT  I Of!  (for  example  2) 


SUBROUT  I HE  CHLCFG  •:  MODE  , H , NSTATE  , NPROB  ) 

IMPLICIT  PEAL*8'.A-H,u-2  > 

REALMS  X < N > , F » G '■  H > 

C 


POSEM BROCK ’ S BHHhHH  FUNCTIOH 


S = X < 2 > - X<  1 >*♦  2 

T = 1.0  - X< D 

F = 100.0*S#*2  + 7>*2 

G 1 1 ) = -H#0.U#S#X<  1 '•  * 2.0*1 

G < 2 > = 200.0*8 

RETURN 

C \ 

C END  OF  CHLCFG 

END 

* 


SPECS 


BEGIN  ROSENBROC1 

ITERATIONS  100 


NONL I NEAR  "ARIRBLES  2 
SUPERBASICS  2 
HESSIAN  DIMENSION  2 


LINESEARCH  TOLERANCE  0.1 

END 


1 


I 

MRS  DATA 


NAME  ROSENBRQC1 

ROWS 

N DUMHVROW 
COLUMNS 
XI 

X2 

RHS 


BOUNDS 
LO  BNDX 

XI 

-10.0 

UP  BNDX 

XI 

1 0 . 0 

LO  BNDX 

X2 

-10.0 

UP  BNDX 

X2 

10.0 

FX  INITIAL 

XI 

-1.2 

FX  INITIAL 

X2 

1 .0 

ENDATA 
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It.  Ttie  INITIAL  bound  set  illustrates  how  the  starting  point 
(xp  x0)  - (-1.2,  1.0)  may  be  specified.  Since  the  limit 
on  SUPERBASICS  is  sufficiently  high  (2  here)  both  x^  and 
xn  will  initially  be  superbasic  at  the  specified  values. 

C 

If  the  INITIAL  bound  set  were  not  used,  and  x^,  would 
initially  be  nonbasic  at  the  smaller  of  their  bounds  (in 
absolute  magnitude),  in  this  case  the  upper  bounds  10.0. 

6.  If  the  user  wished  the  variables  to  be  genuinely  unconstrained, 
the  following  bounds  would  have  to  be  used : 


BOUNDS 


FR 

FREE 

XI 

FR 

FREE 

X2 

FX 

INITIAL 

XI 

-1.2 

FX 

INITIAL 

X2 

1.0 

where  the  INITIAL  bounds  are  again  optional.  If  the  INITIAL 
bounds  were  absent,  X-j  and  xn  would  both  be  regarded  initially 
as  nonbasic  at  value  zero. 

XI. 2.  Example  5 — A Quadratic  Program 

The  following  data  illustrates  solution  of  the  quadratic  program 

IT  T 

minimize  - x Qx  + c x 

subject  to  Ax  < b,  x > 0 
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FUNCTION  HMD  GRADIENT  CALCULhUOM  (for  example  3) 


SUBPOUT  I NE  COLL  I 0 HOOF  , N , M',  1 I E , NPROB  • 

I MF'L  IC  IT  REFILLS A-H  « U- • J ' 

REALMS  X<N>,F,GOH> 

COMMON  Q'-3j3> 

C 

C COMPUTATION  OF  F = 1/2  0 = Q*X  FOR  6IUEN  0. 

C THE  COMMON  STATEMENT  AND  SUBROUTINE  SETG  ARE  PROBLEM 

C DEPENDENT. 

C 

C 

IF  INSTATE. EQ. 1 > CALL  SETO<  ,h  , 

C 

F = 0.0 

DO  300  I = 1 . N 
S = 0 . 0 

DO  200  J = 1 , N 

S - OK  I J ■ + j 

200  CONTINUE 

F = XCI)*S  + F 
Q < I > = S 
300  CONTINUE 
C 

F ^ 0.5*F 

RETURN 

END 


SPECS 


BEGIN  OP 

ITERATIONS  50 

NONLINEAR  UARIABLES  3 

END 


MRS  DATA 

NAME 
ROWS 
M C 
L A 

COLUMNS 

QP 

XI 

c 

-S.0 

H 

1 .0 

X2 

C 

-6.0 

A 

1 .0 

X3 

c 

-H.0 

A 

2.0 

RHS 

B 

A 

3.0 

ENDATA 
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for  the  particular  data 


U 2 2 

-8 

Q = 

2 U 0 

c = 

-6 

2 0 2 

-4 

A = 

[ 1 1 2 ] 

b = 

3 

Notes 

1.  The  vector  c is  included  as  a free  row  in  the  constraint 
matrix,  as  in  standard  LP. 

2.  The  < shown  above  may  of  course  include  all  forms  of  inequality 
as  desired. 

3.  Often  Q will  not  involve  all  variables.  In  such  cases  it  is 
preferable  to  order  the  variables  so  that  the  nonzero  rows 
and  columns  of  Q are  grouped  together  thus: 


The  number  of  NON  LI N EAR  VARIABLES  and  the  parameter  N of 
subroutine  OALCFG  will  then  be  the  dimension  of  Q. 
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4.  It  is  assumed  that  Q is  initialized  by  some  subroutine  SETQ 
during  the  first  entry  to  subroutine  CALCFG.  The  COMMON 


statement  is  also  problem-dependent  (and  is  included  to  ensure 
that  Q retains  its  values  for  later  entries).  Otherwise  sub- 
routine CALCFG  is  suitable  for  any  quadratic  function  involv- 
ing the  first  N components  of  x. 

5.  Beware  — if  c / 0,  the  factor  1/2  makes  a vital  difference 
to  the  function  being  optimized. 

6.  The  optimal  solution  is 

x = (1.3333,  0.7777,  0.44-44', 

|xTQx  = 8.2222 

cTx  = -17.1111 
objective  = - 8.8888 

XI. 3.  Example  4 — Linear  Least  Squares 

Data-fltting  can  give  rise  to  a constrained  least  squares 

problem  of  the  form 

minimize  ||Xx  - y|L 

x d 

subject  to  Ax  > b,  i < x < u. 
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This  may  be  solved  with  MINGS  by  expressing  the  problem  as 


minimize  — r r 
r,x 


r "free, " l < x < u . 


Notes 

1.  As  usual,  Ax  > b may  include  all  types  of  inequality. 

T 

2.  r = y - Xx  is  the  "residual  vector,"  and  r r is  the 
"sum  of  squares." 

5.  'The  objective  function  and  gradient  are  easily  programmed  as 
f(r)  = 1/2  rTr,  g(r)  = r. 

h.  Use  of  MINOS  in  this  context  is  certainly  not  claimed  to  be 
the  most  stable  or  efficient  method  known.  Stability  depends 
on  the  condition  of  a certain  submatrix  extracted  from 


If  it  is  known  that  most  of  the  variables  x will  be  away  from 
their  bounds,  efficiency  could  be  improved  by  using  the  option 
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MULTIPLE  PRICE 


10 


(say).  This  would  allow  up  to  10  variables  at  a time  to  be 
added  to  the  set  currently  being  optimized,  instead  of  the 
usual  1. 


XI. L.  Example  5 — The  Discrete  i ^ Problem 

An  apparently  similar  data-fitting  problem  is 

minimize  ||Xx  - y || -^ 
x 

subject  to  Ax  > b 


where  ||r||,  a X | r.j  . However,  this  is  best  solved  by  means  of 
1 i 1 

the  following  purely  linear  program: 


maximize 

A,u 


subject  to 


] 


= 0 , 


-1  < A < 1,  p > 0 . 


112 


] 

] 
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1 

] 

1 


- 1 
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1.  The  solution  x is  recovered  as  the  "simplex  multipliers." 

2.  The  optimal  value  of  ||Xx  - y||^  is  the  sum  of  the  absolute 

values  of  the  "reduced  costs"  associated  with  A.  (it  is  also 

T T 

the  maximal  value  of  y A + b u.) 

3.  If  a particular  row  in  A,  b is  required  to  be  an  equality 
constraint,  the  corresponding  component  of  u should  be  a 
free  variable. 

4.  It  does  not  appear  simple  to  include  the  bounds  t < x < u 
except  as  part  of  Ax  > b.  In  such  cases  it  may  be  best  to 
solve  the  original  problem  directly  as  a linear  program,  thus: 


T T 

minimize  [ e e 
r,s 


A 

r 

> 

b 

subject  to 

s 

I -I  X 

X 

= 

y 

r > 0,  s > 0,  t.  < x < u, 

T 

where  e = 1 1 1 •••  1 ]. 
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XII.  Cone lusion 

XII. 1.  A Word  to  the  Linear  Programmer 

Those  familiar  with  commercial  mathematical  programming 
systems  will  have  noticed  an  absence  of  the  usual  algorithmic  options 
(dual  simplex  method,  GUB,  parametrics,  etc.),  not  to  mention  the 
normal  wealth  of  data  revision  and  file  handling  capabilities.  How- 
ever, it  should  be  clear  that  MINOS  is  intended  for  use  as  an 
extension  of  such  systems,  not  as  a substitute.  Certainly  the  neces- 
sary constraint  data  can  be  prepared  and  revised  using  standard  matrix 
generators  and  the  above-mentioned  facilities.  In  fact,  we  would 
recommend  that  any  sizeable  model  be  thoroughly  "debugged"  as  a 
purely  linear  program,  using  either  MINOS  or  (preferably)  a commercial 
system.  An  appropriate  set  of  bounds  can  be  used  to  fix  the  nonlinear 
variables  at  plausible  values  during  this  debugging  stage.  The  final 
optimal  solution  thus  obtained  will  generally  provide  a good  start- 
ing point  when  the  nonlinear  objective  is  introduced  and  the  bounds 
on  nonlinear  variables  are  relaxed.  (In  this  context  it  is  essential 
to  follow  the  suggestions  of  Section  VI.) 

Note  that  if  the  constraint  data  has  already  been  debugged, 
i the  INITIAL  bounds  set  of  Section  III. 2 allows  this  fixing  and 

subsequent  freeing  of  nonlinear  variables  to  be  accomplished  automa- 
tically within  a single  run. 
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XI  1.2.  To  the  Nonlinear  Programmer 

Nonlinear  programming  might  reasonably  be  expected  to  include 
nonlinear  constraints — another  vital  subject  which  has  received  no 
mention  here.  In  answer  to  this  point  we  can  only  say  that  there  is 
something  fundamentally  special  about  linear  constraints,  namely  that 
it  is  possible  to  stay  on  them  with  relative  ease.  In  implementing 
MINOS  we  have  shown  that  a significant  class  of  large-scale  linearly 
constrained  problems  can  be  solved  with  only  moderately  more  effort 
than  would  be  required  by  a linear  program  of  the  same  dimensions. 

This  situation  changes  dramatically  with  the  slightest  mention  of 
nonlinear  constraints  (unless  perhaps  they  are  included  as  penalty 
terms  in  the  objective — a strategy  which  normally  leads  to  ill-condi- 
tioned problems  and/or  crude  approximations  to  the  solution). 

To  illustrate,  the  Generalized  Reduced -Gradient  method  of 
Abadie  and  Carpentier  (1969)  is  directly  analogous  to  the  reduced- 
gradient  approach  used  in  MINOS,  but  an  order  of  magnitude  more  work 
is  involved  (for  the  more  general  problem)  in  maintaining  feasibility 
with  respect  to  the  nonlinear  constraints.  Recently,  a derivative  of 
MINOS  has  been  developed  (MINOS/GRG,  Jain,  Lasdon  and  Saunders,  1976) 
with  the  intention  of  handling  about  100  nonlinear  constraints  and 
several  hundred  sparse  linear  constraints.  As  might  be  expected,  run 
times  on  significantly  nonlinear  problems  have  proved  to  be  5 or 
10  times  what  would  be  typical  if  all  constraints  were  linear.  This 
is  not  to  discourage  use  of  the  system  on  real  problems,  but  it  should 
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serve  to  underscore  the  quantum  difference  between  the  two  types 
of  nonlinear  program.  Alternative  implementations  must  be  pursued 
to  help  narrow  the  gap. 


1 


In  the  meantime,  we  hope  that  for  many  users,  the  facilities 
now  available  in  MINOS  will  provide  a useful  first  step  into  the 
nonlinear  world. 
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AIJ  TOLERANCE  (in  SPECS  file)  40 
ALIGN,  subroutine  40 

ALIGNMENT  TOLERANCE  (in  SPECS  file)  40 
Array  storage  in  MINCS  88,  94 


Bartels-Golub  aetbod  8,  86 
Basic  variables,  definition  cf  9 
Basis 

construction  of  with  LOAE  file  68 

inbedding  of  L0  factorization  in  constraint  aatrix  44 
initial,  construction  of  42 
ref actorizaticn  of  41 
updating  of  LU  factorization  86 
Basis  factorization 

nuaerical  stability  cf  64-66 
row  test  in  84-85 
tolerances  for  coaputing  84-86 
updating  86 

Basis  files  22,  34-36,  58-73 
Bit  sap  (see  OLD  EAS1S  file) 

BN CS  (see  BOUNDS) 
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BOUNDS  section  in  HES  file  28-30 

BS  (in  DUHP/IOAD  file)  67 

BS  (in  iteration  log)  80 

BS  (in  SOLUTION  file)  72 

Buap  and  spike  structure  84-86 


CAICEG,  subroutine 

consistency  with  BPS  file  28 
purpose  22 

saaple  Fortran  for  2,  106,  108 
specification  of  31-34 

CALL  OBJECTIVE  NHEN  OPTIMAL  (in  SPECS  file)  41 
Canonical  fora  of  probleas  solved  by  MINOS  11 
Card  reader,  file  nuaber  for  91 
CHECK  FREQUENCY  (in  SPECS  file)  41 

CHUZB  (special  pivot-row  selection  procedure)  55-56 
COEFFICIENTS  (see  ELEMENTS) 

Cold  start  option  (see  CBASF  OPTION) 

COLUMN  ACTIVITY  (in  SCIUTICN  file)  72 

Coluan  ordering,  iaplicit  12 

Coluan  tolerance,  effect  of  changinq  85 

COLUMNS  (in  SPECS  file)  41 

COLUMNS  section  in  BPS  file  28 

roabining  solutions  to  aaaller  sufcprofcleas  68 
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Comments  in  SPFCS  file,  valid  use  of  39 

Complementarity,  linear  (set  linear  ccipiementarity  problem 

Composite  oblective  technique  57 

Condition  number  of  Hessian  18-21 

Condition  number  of  reduced  Hessian  a ( p roi j ma ti on , estimate 
of  81-82 

Conluqate-gradient  methods 
discussion  1C,  16-IP 
options  available  17 
restarts  18 
switch  to  16,  4 4 

CONJUGATE  GRADIENT  VtFSiON  (in  SPECS  file)  41 

Constrained  linear  least  squares,  example  cf  use  cf  KINGS 
for  110-112 

Constraint  types  allowed  in  MFS  file  28 

CCNV  (in  iteration  log)  82-63 

Convergence  test,  for  opti mizaticn  in  current  subspace  52-53, 
82-83 

CRASH  CPI  ION  34,  42 


Data  required  from  the  user  22-36 
DERUG  LEVEL  (in  SPECS  file)  42 
Default  status  cf  non-speci f ied  variable  74 
Default  values  for  parameters  in  SPECS  file 


Di screte 


problem,  example  of  use  of 


file  25-26 
MINOS  for  112-113 


Disk  files  (see  Easis  files) 

Disk  space  requirements  for  MINOS  load  module  on  IBM 
360/370  101 

DJ  (in  iteration  loq)  79 
DUAL  ACTIVITY  (in  SOLUTION  file)  72 
DUMP  FILE  (in  SPECS  file)  42 
DUMP/LCAC  files  34-35,  65-66 

DUMP/LCAD  files,  distinction  from  FUNCH/TNSERT  files 


ELEMENTS  (in  SPECS  file)  43 

ENCATA  (in  KPS  file)  27,  46 

EPS,  definition  of  88 

EFHCfi  CONDN  (in  basis  file)  60 

ERPCR  MESSAGE  LIMIT  (in  SPECS  file)  43 

Examples  of  use  of  MINOS 

Example  1 (sample  input  ard  output)  2-7 
Example  2 (an  unconstrained  problei)  105-107 
Example  3 (a  quadratic  program)  107-11C 
Fxample  4 (constrained  linear  least  squares) 
Example  5 (the  discrete  problem)  112-113 
EXCESS  I INS  (in  basis  file)  60 
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P (parameter  of  CALCFG)  32 

FACTORIZATION  FREQUENCY  (in  SPECS  file)  43 
Factorization  of  basis  (see  Easis;  Basis  factorization) 
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Factorized  fora  of  Hessian  approximation  15 

File  nuabers  built  into  (1INCS  system  91-92 

FIXED  (in  basis  file)  61 

FIXED  variable , in  DUHE  file  61 

Fora  of  probleas  solved  by  FINCS  6,  11 

Format  of  basis  files  58-73 

Formats,  in  OLD/NEN  basis  files  60-61 

Formats,  in  SOIUTICN  file  54-55,  72-73 

Forrest -Tomlin  method,  simulation  of  numerical  properties  86 

FREE  (in  basis  file)  61 

Free  format  (in  SPECS  file)  23 

FREE  variable,  in  DUMP  file  67 

Free  variables,  in  (IPS  file  28 


G (parameter  of  CALCFG)  32 
Generalized  reduced-gradient  method  115 

GO,  subroutine,  modification  for  a particular  application  95 
GO,  subroutine,  purpose  of  94 
Gradient  vector 

computation  of  (see  CALCFG) 
numerical  check  of  56 


HASH,  subroutine  89-91 

Hash  method,  notes  on  90-91 

Hash  table,  size  of  53 

H-CCNDN  (in  iteration  log)  81 

Hessian  (see  Reduced  Hessian  approximation) 

HESSIAN  DIMENSION  (in  SEECS  file)  43-44 


Identifiers  in  SFECS  file,  valid  use  of  37-38 
Idlist  in  SPECS  file,  valid  use  of  38 

Ill-ccnditioning  of  reduced  Hessian  approximation  81-82 
IHBED  (in  SPECS  file)  44 

Imbedding  of  LU  factorization  of  basis  in  constraint 
matrix  44 

Implicit  variable  types  88 
INFEASIBLE  (in  basis  file)  60 

Infeasitle  solution,  status  cf  variables  in  SOLUTION  file  73 
Infinite  lover  or  upper  bounds,  in  SPECS  file  47,  56 
Infinite  lover  or  upper  bounds,  in  SOlUTION  file  54-55,  72 
Initial  basis,  construction  cf  42 
INITIAL  bounds  set  in  (IPS  file  29 

INITIAL  bounds  set  used  with  CRASH  OPTION  2 29-30,  114 

Initial  point  (see  Starting  methods) 

INITLZ,  subroutine  87-89 
Input,  file  number  for  91 
Input  to  HIIQS,  example  of  3 
INPUT  FILE  (in  SPECS  file)  45 
Input  files,  order  in  vhich  read  22 
INSERT  file  34-35,  62-65 
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INSERT  PILE  (in  SPECS  file)  45 

Inteqer  constant  in  SPECS  file,  valid  osp  of  38 
INVERT  FFEQIIENCY  (see  PACT  C F 12  AT  ION  FREQUENCY) 
Iteration  loq  78-83 
ITERATIONS  (in  SFECS  file)  45 
IT N (in  iteration  loq)  79 
IT  NS  (see  ITERATIONS) 


I (in  iteration  log)  PC 

Linear  complementarity  problem  50 

Linear  variables,  definition  cf  11 

linesearch  procedure,  discussion  of  46 

LINESEAFCH  TOLEPAVCE  (in  SFECS  file)  45-46 

LIST  LIMIT  (in  SFECS  file)  46 

LL  (in  PUMP/LOAF  file)  67 

LL  (in  PUNCH/I N S P FT  file)  64 

LL  (in  SOLUTION  file)  72 

LCAP  file  34-35,  65-68 

LOAD  FILE  (in  SPECS  file)  46 

LOG  FREQUENCY  (in  SFECS  file)  47 

Loqical  variables  (see  Slack  variables) 

LOWER  BOUND  (in  SPECS  file)  47 
LOWER  UNIT  (in  SCIUTICN  file)  72 

LU  factorization  of  basis  (see  Easis  factorization) 

LU  CCI  TCLEFANCF  (in  SPECS  file)  47 

LU  POD  TOLERANCE  (in  SPECS  file)  47 

LU  hCW  TOLERANCE  (in  SFECS  file)  47 


Mathematical  Programming  Systems  9,  35 

Matrix  Generator  module,  use  with  MINOS  95-96 

MAXIMIZE  (in  SPECS  file)  47 

MINIMIZE  (in  SPECS  file)  47 

Minor  iterations  of  standard  IF  48 

MI NOS/GFG  115 

MINCS 

array  storage  in  68,  94 

as  extension  of  commercial  IF  systems  114 
definition  cf  name  1 

disk  storaqe  requirements  for  load  module  on  IBM  360/370  1C1 

form  of  protlems  solved  by  8,  11 

implementation  cn  ncn-IBE  36C/37C  87-92 

iterative  use  to  sclve  sequence  of  problems  96-97 

length  of  source  code  87 

MAIN  program  94 

order  in  which  input  files  are  read  22 
purpose  of  8 

subroutine  structure  withir  92-95 

system  information  for  IPM  360/370  98-104 

to  compile  and  save  the  lead  module  on  IBM  360/370  98 

to  compile  CAICFG  and  lirk  *c  MINOS  on  IBM  360/370  100-101 

to  create  and  save  a new  load  module  on  IBM  360/370  101-104 
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to  run  on  IBM  360/37C  9S-10C 

use  as  subroutine  92-97 
MODE  (parameter  of  CALCFG)  32 
BPS  data,  definition  of  for  a at  27-31 
BPS  data,  purpose  22 
BPS,  KFSX,  KPSX/370  9 
BU1TIFLE  PRICE  (in  SPECS  file)  47-49 
Multiple  pricing  47-4S,  78 


N (parameter  of  CALCFG)  32 
NABP  card  in  BPS  file  28 

NEW  EASIS  file  34-35,  58-62  (also  see  OLD  BASIS  tile) 

NEW  BASIS  FILE  (in  SPECS  file)  49 

NPG  (in  iteration  log)  81 

NINF  (in  iteration  log)  BC 

Nonbasic  variables,  definition  of  9,  12 

NONLINEAR  V APIAELES  (in  SPECS  file)  49-50 

Nonlinear  constraints  115 

Nonlinear  variables,  definition  cf  11 

NOFT  (in  iteration  log)  79 

NPRCB  (parameter  of  CALCFG)  34 

NSE  (in  iteration  log)  81 

NS FK  (in  iteration  loq)  80 

NSTAIE  (parameter  of  CALCFG)  33 

Numerical  stability  of  basis  factorization  84-86 
NHORDH,  definition  of  88-69 
NWORDI,  definition  of  88-89 
NWOPDR , definition  of  88-89 


OBJ  GPADIENT  (in  SOLUTION  file)  72 
CBJECIIVE  (in  iteration  log)  81 
OBJECTIVE  (in  S F ECS  file)  5C-51 
Objective  function 

desirable  properties  of  1 
evaluation  of  (see  CALCFG) 
linear  part  of  11-12,  5C-51 
nonlinear  part  of  (see  CALCFG) 
singularities  in  31 
OLD  EASIS  file  34-35,  58-62 

OLD  BASIS  file,  initialization  of  variables  with  61-62 
OLD  BASIS  PILE  (in  SPECS  file)  51 
OPTIBAL  SOLN  (in  basis  file)  6C 

Optimization  in  subspace,  convergence  test  for  52-53,  82-83 

Ordering  of  input  files  22 

Ordering  of  P PS  data  27 

Ordering  of  series  of  problets  77 

Ordering  of  variables,  in  DCEF  file  67 

Ordering  of  variables,  in  FONCH  file  64 

Output  froa  HINOS,  cxaaple  cf  4-7 
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Partial  basis  specified  in  LOAD  file  68 

PARTIAL  PRICE  (in  SFECS  file)  *1 

Partial  pricing  47-49,  51#  IP 

PH  (in  iteration  log)  79 

Phase  1 30#  79 

Phase  2 30,  79 

Phase  3 79,  81-83 

Phase  4 52-53,  75,  bl-63 

FI  V01  (in  iteration  log)  PC 

PP  (in  iteration  log)  79 

Preassigned  pivct  procedures  84 

Pricing  47-49,  51,  78 

Printer,  file  numter  for  92 

Problem  forms  solved  by  HINCS  8,  11 

PROBLF*  NO.  (in  SPECS  file)  52 

Prcblem  specifications  37-57 

PROCEEDING  (in  basis  file)  49,  60 

Projected  Hessian  (see  Reduced  Hessiar.  approximation) 
Protection  against  accidental  specification  of  infinite 
bounds  74 

PUNCH  F I IF  (in  SFECS  file)  52 
PUNCH/INSFPT  files  34-35,  62-65 

PUNCH/INSEPT  files,  distinction  from  DUMF/LOAD  files  65 
P?,  g4 


Quadratic  programming,  example  of  use  cf  MINDS  for  107-110 
Quasi -Newtor.  approximation  (see  Reduced  Hessian  approximation) 
Quasi-Newton  iterations,  suppression  of  17 
Quasi -Newton  method  10 


RANGES  (in  SPECS  file)  52 
FANGES  section  in  MPS  file  28 

Fank-cne  modification  of  reduced  Hessian  approximation  15-16 

Real  constant  in  SPECS  file,  valid  use  of  38-39 

Record  format  for  scratch  file  92 

REDUCED  COST  (in  SOIUIICN  file)  72 

Reduced  function  14 

Reduced-gradient  method  9,  14 

REDUCED  GRADIENT  TOLERANCE  (in  SFECS  file)  52-53 
Reduced  Hessian  approximation 
definition  10,  14-16 

estimate  of  condition  nuiter  18-21,  81-82 
ill-conditioning  of  8 1 - e 2 
maintenance  in  factorized  form  15 
. modification  of  15-16,  4S 
quasi-Newton  15 

specification  cf  ditensicn  16-17 
storage  of  43-44 

updating  and  expansion  cf  15-16,  49 
Refactcrization  of  basis  41 

Relaxing  of  bounds,  in  restarting  modified  problems  74-76 


125 


Report  Writer  Module,  use  with  MINOS  95-96 

Restarting  Modified  problems  74-77 

Revised  simplex  Method,  implementation  of  8 

REWIND,  in  Fortran  92 

RG  (in  iteration  log)  79 

RHS  (in  SPECS  file)  53 

EH S section  in  MES  file  26 

Right-hand  side  variable,  definition  cf  11 

Right- -Justi f icaticn  of  exponent  in  INSERT  file  65 

PNG,  RNGS  (see  RANGES) 

ROW  ACTIVITY  (in  SOLUTION  file)  72 
Row  test  in  basis  factorization  64-85 
Row  tolerance,  effect  of  changing  85 
ROWS  (in  SPECS  file)  53 
ROW?  section  in  EES  file  26 
RIM  (in  iteration  log)  16,  61 


SAVE  FREQUENCY  (in  SPECS  file)  54 
SB  (in  DUHP/LOAC  file)  67 
SB  (in  EUNCH/INSERT  file)  64 
SBS  (in  iteration  log)  80 
SB S (in  SOLUTION  file)  72 
Scaling 

comments  on  adjustment  2C-21 
constraints  20,  30-31 
nonlinear  variables  18-21 
Scratch  file  92 

Series  of  problems,  ordering  of  77 
Simplex  multipliers  (in  SOIUTICN  file)  72 
SINF  (in  iteration  log)  81 
Singularities  in  objective  fuccticn  31 
SLACK  ACTIVITY  (in  SOLUTION  file)  72 
Slack  variables,  definition  cf  12 
SOLUTION  (in  SPECS  file)  54-55 
SOLUTION  file  34,  36,  68-73 
SPECS  file 

default  values  for  parameters  of  24-26 
definition  of  foraat  22-26 
example  of  25-26 
form  of  input  37-39 
keywords  39-57 
purpose  22 
syntax  of  37-39 
Spike  coluans  ec,  64-86 
Starting  methods 

cold  start  (see  CRASH  OPTION) 
in  restarting  modified  problems  74-77 
use  of  INITIAL  bounds  set  29-30 
use  of  INSERT  file  62-65 
use  of  LOAD  file  65-68 
use  of  OLD  BASIS  file  56-62 
State  of  variables  (in  basis  file)  60-61 
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STFP  (in  iteration  Icq)  PC 
Subroutine  hierarchy  in  (IT  NC  £ ^c-93 

Subroutine  to  evaluate  cMective  function  (see  CALCFG) 
Superbasic  variables 
definition  of  9 

role  rn  reduced-gradient  lethod  9 
value  of  concept  in  linear  problems  10 
SUPERBASICS  (in  SPECS  file)  55 


1ARGFT  OBJECTIVE  VAIUE  (in  SPECS  file)  55-56 

Tightening  of  bounds,  in  restarting  modified  problems  77 

Tolerances 

column  (Tc)  , effect  of  changing  85 
for  computing  the  basis  f actor izati cn  84-86 
for  ignoring  matrix  coefficient?  40 
for  linesearch  accuracy  45-46 
for  optimization  in  subspace  52-53,  82-83 
selection  for  a given  prctlem  size  and  sparsity  86 
row  (Tr)  , effect  of  changing  35 
Too  many  basics  specified  in  1CAD  file  68 


U (in  iteration  log)  6C 
UL  (in  DTJMP/LCAD  file)  67 
UL  (in  PUNCH/INSERT  file)  64 
UL  (in  SOLUTION  file)  72 
UNEGUNDED  (in  basis  file)  6C 

Unconstrained  optimization,  example  of  use  of  MINOS  for  105-107 

Updating  of  reduced  Hessian  approximation  15-16,  49 

Updating  of  LU  factorization,  tolerance  for  86 

UPPER  BCUND  (in  SPECS  file)  56 

UPPER  LIMIT  (in  SOLUTION  file)  72 


Variable-metric  method  (see  Cuasi-Newtcn  method) 
Variable  types,  implicit  8P 

Variables,  state  of,  indicatcrs  in  basis  file  60-61 
VERIFY  (in  SPECS  file)  56 


Weapon  assignment  problem,  used  to  illustrate  basis  file 
formats  58 

WEIGHT  ON  OBJECTIVE  (in  SPECS  file)  £7 


X (parameter  of  CALCFG)  32 
XL  (in  FUNCH/INSERT  file)  64 
XU  (in  PUNCH/INSERT  file)  64 


l , matrix,  definition  of  14 
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Linearly  constrained  optimization;  optimization;  linear  programming; 
nonlinear  programming;  sparse  matrices;  MINOS;  mathematical  software  ; 
large-scale  optimization. 
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MTNOS  is  a Fortran  program  designed  to  minimize  a linear  or  nonlinear  function 
subject  to  linear  constraints,  where  the  constraint  matrix  is  in  general  as- 
sumed to  be  large  and  sparse.  The  User's  Guide  contains  an  overview  of  the 
MINOS  System,  Including  descriptions  of  the  theoretical  algorithms  as  well  as 
the  details  of  implementation.  The  Guide  also  provides  complete  instructions 
, for  the  use  of  MINOS,  and  illustrates  the  diversity  of  application  by  several 
examples* 
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